Skupper on Rafael Zago

Skupper + InstructLab: controlling and protecting AI (act 3)

Mon, 05 May 2025 00:00:00 -0300

See the Solution in Action

In this article we deploy the InstructLab chatbot on Kubernetes step by step, using Skupper to securely connect a private AI model to a public interface. This is the hands-on continuation of the solution pattern from the previous article.

Concepts and Commands Used in the Demo

NOTE: The following commands configure the environment and deploy the InstructLab chatbot. They are taken from the InstructLab project and adapted for this demo.

Skupper + InstructLab: controlling and protecting AI (act 2)

Sun, 04 May 2025 00:00:00 -0300

See the Solution in Action

In this article we prepare the full environment to serve the generative DeepSeek AI model with InstructLab: download the model, convert it to GGUF, and deploy the InstructLab chatbot. We also expose the service securely with Skupper.

Concepts and Commands Used in the Demo

NOTE Make sure you explain what each Skupper command does the first time you use it, especially for people new to Skupper. The following commands should be explained:

Skupper + InstructLab: controlling and protecting AI (act 1)

Fri, 02 May 2025 00:00:00 -0300

The story behind this solution pattern

Growing demand for AI-driven applications brings a hard problem: how do you deploy and operate AI models securely in environments that need strict data protection, while those models still have to be reachable by public services? That need became clear while building a local AI chatbot meant to handle sensitive and proprietary information — we needed a design that kept the model inside a protected environment.

InstructLab and Skupper: local AI without exposing data

Thu, 01 Aug 2024 00:00:00 -0300

Welcome to the Ollama Pilot.

Problem to solve

The main goal of this project is to create a secure connection between two sites, enabling the communication between the engineer machine and an Instruct Lab Model. The merlinite-7b-lab-Q4_K_M.gguf model will be used for the chatbot, and it is available in the Instruct Lab. The license of the model is available in the Instruct Labs.

But, why the banner? Well, the engineer needs to know who is better, Lebron or Jordan. The chatbot will be responsible for answering this question. The chatbot will receive the user input and send it to the llama3 model. The response from the merlinite model will be sent back to the user.

Skupper workshop: Patient Portal on Kubernetes

Tue, 02 Jul 2024 00:00:00 -0300

Description

This workshop introduces Red Hat Service Interconnect, an application integration solution that lets different systems communicate efficiently and securely.

Solution architecture

Service topology

Workshop outline

Sign in to Red Hat Developer.
Create an OpenShift cluster.
Access the OpenShift cluster.
In the Red Hat OpenShift Sandbox project, open your project.
Create a virtual machine with OpenShift Virtualization.
Install packages on the virtual machine:
- podman
- kubernetes-client
- skupper
- oc
- wget
Deploy the database with Podman.
Deploy the application frontend and backend.
Configure Service Interconnect (Skupper) so the database running under Podman can talk to the app on OpenShift.
Access the application and confirm communication works.
Closing notes.

Links

Resource	Link
[1] Red Hat Developer	https://developers.redhat.com/
[2] OC	https://docs.openshift.com/container-platform/4.15/cli_reference/openshift_cli/getting-started-cli.html
[3] Skupper	https://skupper.io/

Prerequisites

A Red Hat Developer account
Basic Kubernetes knowledge
Basic Red Hat OpenShift knowledge
Basic Podman knowledge
Google Chrome preferred—it lets you paste commands into the VM console over browser VNC.

Step by step

Go to Red Hat Developer and sign in with your account.

OpenShift AI and Skupper: insurance fraud prevention

Mon, 17 Jun 2024 00:00:00 -0300

Description

This workshop demonstrates how to use Skupper to connect local data services to cloud-based AI/ML environments. The workshop includes a Go application in a podman container that exposes internal data for Skupper connection. The AI/ML model training is performed in an OpenShift AI cluster on AWS using Openshift AI/ML services.

Disclaimer

This lab uses the example from the AI/ML Workshop created by the Red Hat AI Services team. The original workshop is available on GitHub and includes all the necessary information to run the lab. The lab was adapted to use Skupper to connect the local data services to the cloud-based AI/ML environment.

TemPy: IoT with Raspberry Pi, Skupper, and Grafana

Thu, 15 Feb 2024 00:00:00 -0300

Description

This project is a proof of concept for an IoT architecture using a Raspberry Pi and a temperature sensor that exposes the temperature data through a REST API. Along with the REST API, there is a cloud integration with any cloud provider using Skupper that enables the data to be visualized in a Grafana dashboard.

Clone the repository and follow the instructions to run the project. https://github.com/rafaelvzago/skupper-tempy

git clone https://github.com/rafaelvzago/skupper-tempy.git

Architecture

CI/CD upstream vs downstream: when to use each

Fri, 02 Jun 2023 00:00:00 -0300

Integrating Skupper upstream and downstream

Integrating upstream and downstream projects is rarely simple. Here is a practical approach for Skupper on the upstream side and its commercial downstream line, using familiar tools for each side of the work.

Introduction

Skupper is an open-source project that provides a service network for Kubernetes. It is developed by Red Hat and released under the Apache 2.0 license. That is the upstream version—the one under active development.

Skupper: multicloud app network in a few commands

Sat, 01 Oct 2022 00:00:00 -0300

References and technologies used

Tools

A computer with minikube [2] installed;
A terminal to run the commands;
kubectl > 1.15 [6] or newer.

Solution overview

Skupper [1] lets you connect two or more cloud environments in a non-intrusive, secure way. Those environments can sit on different cloud providers—AWS, GCP, Azure, and others—or on native Kubernetes clusters.

Skupper on Rafael Zago

Skupper + InstructLab: controlling and protecting AI (act 3)

See the Solution in Action

Concepts and Commands Used in the Demo

Skupper + InstructLab: controlling and protecting AI (act 2)

See the Solution in Action

Concepts and Commands Used in the Demo

Skupper + InstructLab: controlling and protecting AI (act 1)

The story behind this solution pattern

InstructLab and Skupper: local AI without exposing data

Welcome to the Ollama Pilot.

Problem to solve

Skupper workshop: Patient Portal on Kubernetes

Description

Solution architecture

Service topology

Workshop outline

Links

Prerequisites

Step by step

1. Sign in to Red Hat Developer

OpenShift AI and Skupper: insurance fraud prevention

Description

Disclaimer

TemPy: IoT with Raspberry Pi, Skupper, and Grafana

Description

Table of Contents

Architecture

CI/CD upstream vs downstream: when to use each

Integrating Skupper upstream and downstream

Introduction

Skupper: multicloud app network in a few commands

References and technologies used

Tools

Solution overview