Draft. Work in progress: an outline with working notes. The finished post will replace it.
Local AI as security infrastructure
Privacy, model control, isolation and reproducibility: why running models yourself matters beyond cost.
The usual argument for local models is cost. For security work the stronger arguments are control and containment.
Privacy and data handling
- Sensitive material never leaves the environment.
- [TODO: which kinds of work this enables]
Model control and reproducibility
- Pinned models and settings; results you can reproduce.
- [TODO: why reproducibility matters for evidence]
Isolation
- Agents with local models can run in closed networks.
- [TODO: lab setup at a high level]
The trade-offs
- Capability, hardware, maintenance.
- [TODO: honest assessment]