Project 02 // GPU Pipeline
Hardware-aware local manga colorization built around real GPU inference, automated installation, automatic CUDA/PyTorch runtime selection, and local-only processing. No cloud API in the loop: the GPU doing the work is yours.
Demo
Real local inference. Black-and-white manga in, colorized page out. This GIF is a real capture of AI9 taking a B&W page through the local GPU colorization workflow.
The Real Thing
The demo above, the extension popup, and the live backend check were captured from this project's own repository and its actually-running install, not staged or drawn.
$ curl -sk https://127.0.0.1:5000/
Manga Colorizer is Up and Running!
This is the same install this page tells you how to run: a real Flask backend, a real GPU behind it, and the real Windows background task (MangaColorizerAI9) keeping it alive between crashes and reboots.
In the Otaconskeep Story
Otacon is the agent platform. Genome Voice Trainer clones Piper voices for those agents on your GPU. AI9 is the manga colorizer — proof of the same discipline on a standalone GPU pipeline: detect real hardware, select the exact runtime, fail loudly when something's wrong, never a silent cloud fallback. See the demo GIF above for B&W → color on a real local install.
Architecture
Concurrency is 1 by default: one page colorizes at a time, queued, so the GPU stays available for other work. A two-tier cache keyed by image content hash and processing options means switching color presets on an already-read page reuses the raw GPU output instead of a full re-run.
Hardware Support
The installer reads your GPU name and driver's max CUDA version directly from nvidia-smi, then picks the matching PyTorch wheel. No manual CUDA version guessing.
| GPU generation | Compute capability | PyTorch build |
|---|---|---|
| RTX 50-series (Blackwell) | sm_120 | cu128 |
| RTX 40-series (Ada) | sm_89 | cu121 / cu126 |
| RTX 30-series (Ampere) | sm_86 | cu118 |
Verified with a real GPU inference pass (matmul + cuDNN convolution kernels), not just torch.cuda.is_available(). That call can return True while still lacking compiled kernels for your specific architecture.
Install
AI9's installer targets Git Bash on Windows and refuses to run under WSL. It is not a Linux-style curl | bash one-liner. Here's the real supported path.
No WSL, no Linux VM, nothing to install ahead of time. If Git Bash isn't already on your machine, install_ai9.bat installs it for you automatically.
GitHub's green Code button → Download ZIP (then extract it), or git clone it.
install_ai9.bat
It finds or installs Git Bash automatically, then runs the real installer, install_ai9.sh, inside it.
Open Git Bash in the extracted folder and run:
./install_ai9.sh
Installs Python 3.12, Git, and Firefox if missing (via winget); detects your GPU and installs the matching PyTorch build; downloads and verifies the AI model weights; runs a real GPU inference test; registers a Windows background task so the server auto-starts and restarts itself on crash.
Firefox requires a human click for unsigned add-ons. No installer can do this part. Go to about:debugging#/runtime/this-firefox → Load Temporary Add-on → select extension/manifest.json from the install folder. This needs repeating after every full Firefox restart.
| Variable | Default | What it changes |
|---|---|---|
| AI9_INSTALL_DIR | C:\opt\manga-colorizer | Where AI9 gets installed |
| AI9_INSTALL_FIREFOX | 1 | Set to 0 to skip installing Firefox |
| AI9_REGISTER_TASK | 1 | Set to 0 to skip auto-registering the background service |
Status
Known limitations (from the repository's own troubleshooting notes):