LLM/self-hosted-ai-starter-kit
1
0
Fork 0
mirror of https://github.com/n8n-io/self-hosted-ai-starter-kit.git synced 2025-11-29 08:33:15 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
c1ee388c67c9f32095ca579532fd25a023175bf7
self-hosted-ai-starter-kit/README.md
jeanpaul c1ee388c67 Remove mentions of infinity in README (#2)
2024-08-07 11:36:16 +02:00

1.1 KiB
Raw Blame History

n8n Demo setup

This repo helps quickly bootstrap an n8n demo environment using docker-compose.

Requirements

  • Docker compose
  • Optionally an Nvidia GPU for faster inference on Ollama

Setup

  • Clone this repo
  • Optionally edit the credentials in the .env file
  • Start the containers:
    • If you have an Nvidia GPU, run docker compose --profile gpu-nvidia up
    • Otherwise to run inference services on your CPU, run docker compose --profile cpu up
  • Wait a couple of minutes for all the containers to become healthy
  • Open http://localhost:5678 in your browser and fill in the details
  • Open the included workflow: http://localhost:5678/workflow/srOnR8PAY3u4RSwb
  • Wait until Ollama has downloaded the llama3.1 model (you can check the docker console)

Included service endpoints

Updating

  • Run docker compose pull to fetch all the latest images
  • Run docker compose create && docker compose up -d to update and restart all the containers