Independent consulting on private & agentic AI
Stefan Ostermann
Private & Agentic AI · Local LLM Infrastructure · Software and IT Management · eCommerce · Information Security & Compliance
Over 20 years building software that scales. Lately I help teams work out where public AI makes sense — and where it's smarter to keep the AI on your own hardware.
01 — About
There is a machine in my basement with two graphics cards. AI models work on it day and night. Nobody can rate-limit them, nobody can raise the price, nobody reads along. It started as an after-hours project. It is now one reason I left my job.
After many years leading software and product development, most recently as Head of Development, I advise companies on private and agentic AI: which hardware, which models, which architecture. So that AI actually becomes productive and the data stays inside the company.
The road to AI does not have to run through a US cloud provider. A lot of what is billed per user per month today runs locally: fast enough, cheap enough, and auditable. I will work much more operationally again, closer to the metal: I will build software myself again, AI-assisted. What used to need a team can now be done alone because AI agents handle the grunt work in the background. That gives me time for the part that matters most now: working with people.
02 — Availability
I have capacity.
For projects, sparring, and partnerships around private and agentic AI: from which hardware is worth buying, to picking the models, to an architecture that holds up in production.
I am starting solo, with a clear plan to grow together with a partner. And if someone comes to mind who is facing exactly these questions, I would be glad for an introduction.
03 — Expertise
AI Infrastructure & Strategy
I set up and run private AI environments: local LLMs like Gemma 4 or Qwen on your own hardware. The data stays in-house and your costs stay predictable.
AI-Driven Development
Helping teams ship faster with AI-assisted coding and automated pipelines (without handing your source code or IP to anyone else).
eCommerce & Scalable Systems
Building eCommerce platforms that stay fast and stable as they grow and that people actually like using.
Technical Leadership
Leading teams, planning, and owning budgets on complex software projects. Making sure the business side and the engineering side actually understand each other.
Information Security & Compliance
I've worked hands-on through ISO 27001 and TISAX certifications and built GDPR-compliant systems. I guided pen tests and make developers aware of the OWASP top 10. For German Mittelstand companies that have to take security and data protection seriously.