Self-Hosted LLM Deployment
Running language models on your hardware. Open WebUI, LM Studio, and Ollama on bare-metal or virtualized hosts. RAG pipelines with Qdrant or ChromaDB. Inference stays on-premises — no API calls leaving your network.
whoami
Infrastructure deployment and AI systems consulting.
Self-hosted, secure, yours.
Running language models on your hardware. Open WebUI, LM Studio, and Ollama on bare-metal or virtualized hosts. RAG pipelines with Qdrant or ChromaDB. Inference stays on-premises — no API calls leaving your network.
RHEL, Rocky Linux, Ubuntu Server, Proxmox VE, and VMware vSphere. Storage with TrueNAS (ZFS). SELinux hardening, user/group management, and ongoing maintenance. Systems designed to be operated, not just installed.
Ansible playbooks for repeatable deployments. Docker Compose and Kubernetes for containerized workloads. CI/CD pipelines with GitHub Actions. Infrastructure-as-code that your team can read, version, and own.
OPNsense firewalls, VLAN segmentation, WireGuard VPNs. Grafana dashboards backed by Prometheus and Loki. Alertmanager for on-call routing. Networks built to be observable from day one, not retrofitted later.
Python-based ETL pipelines. FastAPI backends with SQLite or PostgreSQL. Cloudflare Pages for static front-ends. SHA256 hash chains for audit integrity. Projects built for transparency and correctness, not scale-up narratives.
Civic accountability platform correlating environmental sensor readings and health metrics with municipal and federal policy decisions. Record integrity via SHA256 hash chain. Designed to be auditable, not just searchable.
Firefox-first browser extension for family network content filtering. Community-maintained blocklists. No cloud calls, no telemetry, no account required. Runs entirely client-side.
Agentic development workflow with self-improving validation loops. Integrates CodeGuard static analysis and Semgrep CE security scanning. Catches regressions before they ship rather than after.
Email is the best way to reach us. Describe what you're working on and we'll respond within a business day.
info@helpdeskpro.ca