Overview
Fighting Data Entropy: Architected a robust handling system for "The Sanitization Gap"—solving the failure of predictability when web-based metadata meets rigid filesystem constraints.
Atomic Symlinking: Implemented a virtualization layer that creates a parallel "Human-Readable View" while keeping the Source of Truth immutable and untouched.
Async Race Condition Mitigation: Refactored core logic to prevent "Ghosts in the Machine" by ensuring filesystem locks are 100% verified before moving to consecutive metadata pages.
Recursive Depth Handling: Engineered a self-invoking crawling engine to bypass pagination memory limits, preventing the "Cryptic String Wasteland" in massive libraries.
Demo
The Challenge: Fighting Data Entropy
The "Sanitization Gap" isn't just a naming issue; it's a failure of predictability.
In high-volume async syncs, you're fighting the clock. If the script moves to the next page before the file system has finished locking the previous symlink, you end up with orphaned files—ghosts in the machine that exist in the database but have no physical path.
Most APIs and scrapers have a "memory" problem. When you hit a recursive depth limit, the organization just stops, leaving half your library organized and the other half in a "cryptic string" wasteland.
Humans love using #, $, and % in titles. Systems hate them. These "illegal" characters cause path escaping errors that break the sync mid-way, leading to the dreaded "Broken Sync" state where nothing matches the source.
The Solution: Non-Destructive Virtualization
I didn't just write a "renamer." I built a Symlink-based Virtualization layer—decoupling the Source of Truth from the User Interface entirely.
Instead of moving files and hoping the async catch-up works, the tool creates a parallel "view" of the data. This keeps the Source of Truth (the TubeArchivist database) untouched and immutable.
The tool intercepts those # and $ symbols at the symlink layer. You get a human-readable folder like [#] Project_Alpha, while the system stays happy with the original source path.
Because it uses symlinks, there's no duplicating terabytes of data. It's a 1:1 virtual mapping that can be served by any file manager or media server instantly.
Eliminated orphaned "ghost files," bypassed library depth constraints, and delivered a zero-storage-overhead "Netflix-style" view with 100% OS parity.