Deepseek on Rafael Zago

Skupper + InstructLab: controlling and protecting AI (act 2)

Sun, 04 May 2025 00:00:00 -0300

See the Solution in Action

In this article we prepare the full environment to serve the generative DeepSeek AI model with InstructLab: download the model, convert it to GGUF, and deploy the InstructLab chatbot. We also expose the service securely with Skupper.

Concepts and Commands Used in the Demo

NOTE Make sure you explain what each Skupper command does the first time you use it, especially for people new to Skupper. The following commands should be explained:

Skupper + InstructLab: controlling and protecting AI (act 1)

Fri, 02 May 2025 00:00:00 -0300

The story behind this solution pattern

Growing demand for AI-driven applications brings a hard problem: how do you deploy and operate AI models securely in environments that need strict data protection, while those models still have to be reachable by public services? That need became clear while building a local AI chatbot meant to handle sensitive and proprietary information — we needed a design that kept the model inside a protected environment.