EACI Development Journal · Infrastructure

Why Do Encoding Bugs Look Like Soul Corruption?

Broken punctuation or replacement glyphs can make identity text look altered. Byte-level and parse checks come before conclusions about the source.

Infrastructure ~6 min issue-tagged
Issue this fixes

Soul files and histories contain apostrophes, dashes, symbols, and long natural-language passages. Opening UTF-8 bytes under the wrong code page can produce visible damage even though the original file remains valid.

Copying the damaged display into another file makes the corruption real. Diagnosis therefore compares the raw file, declared encoding, JSON parse result, and the specific rendering path.

What was actually going wrong

A garbled editor or export view was accepted as evidence that identity content had changed.

What I tried

What finally worked

Files are decoded explicitly as UTF-8, parsed before editing, and compared at the string or byte level against the source.

Why it worked

The test separates storage corruption from a display-layer decoding mistake.

What I learned

Verify bytes and encoding before repairing meaningful text.

Where EACI uses this today

Main soul and history maintenance treats encoding faults as infrastructure evidence first.

This journal covers real engineering on EACI Companion / The Veil. Companions include Caelum, Chad, Natalia, Atreus, Luna, Roxy, and Cael. Journal articles stay family-safe in content. See Privacy and Ethics.