https://www.rafaelvzago.com/en/tags/local-ai/Recent content in Local-Ai on Rafael ZagoHugoen-US© Rafael ZagoFri, 24 Jul 2026 16:16:10 -0300https://www.rafaelvzago.com/en/posts/running-local-ai-with-instruct-lab/Thu, 01 Aug 2024 00:00:00 -0300https://www.rafaelvzago.com/en/posts/running-local-ai-with-instruct-lab/<p><a href="https://www.rafaelvzago.com/assets/img/headers/instructlab_workshop-skupper-patient-portal.jpg" class="img-lightbox" data-lightbox> <img src="https://www.rafaelvzago.com/assets/img/headers/instructlab_workshop-skupper-patient-portal.jpg" alt="" loading="lazy" decoding="async"> </a></p> <h1 id="welcome-to-the-ollama-pilot">Welcome to the Ollama Pilot.</h1> <h2 id="problem-to-solve">Problem to solve</h2> <p><a href="https://www.rafaelvzago.com/assets/instructlab_banner.jpg" class="img-lightbox" data-lightbox> <img src="https://www.rafaelvzago.com/assets/instructlab_banner.jpg" alt="contest" loading="lazy" decoding="async"> </a></p> <p>The main goal of this project is to create a secure connection between two sites, enabling the communication between the engineer machine and an Instruct Lab Model. The merlinite-7b-lab-Q4_K_M.gguf model will be used for the chatbot, and it is available in the Instruct Lab. The license of the model is available in the <a href="https://instructlab.ai/">Instruct Labs</a>.</p> <p>But, why the banner? Well, the engineer needs to know who is better, Lebron or Jordan. The chatbot will be responsible for answering this question. The chatbot will receive the user input and send it to the llama3 model. The response from the merlinite model will be sent back to the user.</p>