Commit Graph

433 Commits

Author SHA1 Message Date
Yury Kossakovsky
ef68937d4b fix: add --remove-orphans to main compose up command
prevents container name conflicts when switching profiles by cleaning
up orphaned containers from deactivated services
2025-12-11 11:39:01 -07:00
Yury Kossakovsky
2e81c991e2 fix: add --remove-orphans flag and explicit container names
prevents container name conflicts during restarts by automatically
cleaning up orphaned containers and ensuring langfuse services have
explicit names
2025-12-11 11:39:01 -07:00
Yury Kossakovsky
ee236471a5 fix: add explicit container names for n8n workers and runners 2025-12-11 11:39:01 -07:00
Yury Kossakovsky
e608c4705d refactor: remove hardcoded project name from docker compose commands 2025-12-11 11:39:01 -07:00
Yury Kossakovsky
9088a54540 fix: remove container_name to prevent duplicate containers 2025-12-11 11:39:01 -07:00
Yury Kossakovsky
35ca31d1af fix: address n8n v2.0 migration review issues
- fix quote parsing in N8N_WORKER_COUNT from .env
- remove unused N8N_RUNNER_COUNT references
- parameterize n8n version for both n8n and runner images
- add healthchecks to n8n main and worker services
2025-12-11 11:39:01 -07:00
Yury Kossakovsky
62089b0b4b docs: document worker-runner sidecar architecture
update CLAUDE.md with sidecar pattern details including dynamic
generation, network mode, and scaling instructions. add worker
count and architecture info to final installation report.
2025-12-11 11:39:01 -07:00
Yury Kossakovsky
11622a5d2d chore: update env example for worker-runner sidecar pattern
remove N8N_RUNNER_COUNT (now 1:1 with workers), add
OFFLOAD_MANUAL_EXECUTIONS_TO_WORKERS setting, clarify that
generate_n8n_workers.sh should be run after changing count.
2025-12-11 11:39:01 -07:00
Yury Kossakovsky
98f2dd807e refactor: integrate worker-runner generation into install/update flow
update configure services to call generate_n8n_workers.sh instead of
prompting for separate runner count. update start_services.py and
apply_update.sh to include docker-compose.n8n-workers.yml when present.
2025-12-11 11:39:01 -07:00
Yury Kossakovsky
d54eca620c feat: implement worker-runner sidecar pattern for n8n
replace replicated workers/runners with dynamically generated 1:1
worker-runner pairs where each runner connects to its worker via
localhost (network_mode: service). this improves task routing by
ensuring each worker has dedicated runner capacity.

add generate_n8n_workers.sh script to create docker-compose.n8n-workers.yml
2025-12-11 11:39:01 -07:00
Yury Kossakovsky
bcd2da2dfc fix: update task runner image to match n8n 2.0.0 stable 2025-12-11 11:39:01 -07:00
Yury Kossakovsky
0b7dbffe79 chore: update n8n Dockerfile to use stable version 2.0.0
Replaced the pre-release version 2.0.0-rc.4 with the stable release 2.0.0 in the Dockerfile for n8n.
2025-12-11 11:39:01 -07:00
Yury Kossakovsky
638c3d17a6 feat: add n8n v2.0 external task runner support
upgrade n8n from 1.123.3 to 2.0.0-rc.4 with external task runners for
Code node execution. task runners handle javascript and python code
execution in isolated containers with configurable concurrency.

key changes:
- add n8n-runner service using n8nio/runners:2.0.0-rc.4
- configure runner auth token and broker communication
- add N8N_RUNNER_COUNT for scaling runner replicas
- move code node library config to runner container
- update binary data mode from filesystem to database
- add runner count prompt to installation wizard
2025-12-11 11:39:01 -07:00
Yury Kossakovsky
209c739e7f feat: add generic_timezone env variable for n8n 2025-12-11 11:37:41 -07:00
Yury Kossakovsky
5dbc647a7a build: update n8n image to version 1.123.4 2025-12-09 21:59:04 -07:00
Yury Kossakovsky
c2f6da8746 build: update n8n image to version 1.123.3 2025-12-05 14:44:44 -07:00
Yury Kossakovsky
de327efc61 Update n8n Dockerfile to use image version 1.123.2 2025-12-04 10:38:19 -07:00
Yury Kossakovsky
89fdc93566 Add logging configuration for n8n in environment files
- Introduced N8N_LOG_LEVEL and N8N_LOG_OUTPUT variables in .env.example for logging customization.
- Updated docker-compose.yml to support dynamic assignment of logging configuration, defaulting to 'info' and 'console' respectively.
2025-12-04 10:30:05 -07:00
Yury Kossakovsky
8b562bf16b Update environment variable handling for n8n execution mode in configuration files
- Added EXECUTIONS_MODE variable to .env.example for clarity on execution settings.
- Updated docker-compose.yml to allow dynamic assignment of EXECUTIONS_MODE, defaulting to 'queue' if not set.
2025-12-03 13:06:47 -07:00
Yury Kossakovsky
f70ee5e206 Update n8n Dockerfile to use specific image version 1 instead of latest 2025-12-03 10:15:46 -07:00
Yury Kossakovsky
ac13c400f5 feat(docling): add vlm pipeline configuration and usage instructions
add environment variables for vlm pipeline support (remote services,
model loading, device selection) and persistent cache volume. improve
final report with detailed vlm pipeline usage example showing how to
use ollama with granite3.2-vision model for document conversion.
2025-11-26 17:32:09 -07:00
Yury Kossakovsky
761200adbc Refactor healthcheck command format in docker-compose.yml and standardize PostgreSQL host output in final report script
- Updated the healthcheck command in docker-compose.yml for improved readability by formatting it as a list.
- Standardized the output for PostgreSQL host in 07_final_report.sh to remove environment variable references, ensuring consistent messaging.
2025-11-12 23:13:00 -07:00
Yury Kossakovsky
02e608faf7 Add Docling service to README and update service addition guidelines
- Included Docling service details in the "Quick Start and Usage" section of README.md, providing users with access information.
- Updated the service addition guidelines in add-new-service.mdc to include instructions for adding service URLs in alphabetical order.
2025-11-09 14:28:17 -07:00
Yury Kossakovsky
ba81e717e2 Refactor Docling final report output for clarity and consistency
- Updated the final report script to streamline the output for the Docling service by reorganizing the displayed information.
- Removed redundant lines and ensured that essential details such as API endpoints and user credentials are clearly presented.
2025-11-09 14:24:38 -07:00
Yury Kossakovsky
167b7e97b6 Update Docling image references in .env.example and docker-compose.yml
- Changed the Docling image reference in .env.example and docker-compose.yml to use the correct naming convention for the CPU version, ensuring consistency across configuration files.
2025-11-09 13:51:52 -07:00
Yury Kossakovsky
bb3c6b4810 Update confirmation prompts in secret generation and service configuration scripts to default to 'yes'
- Modified the confirmation prompts in 03_generate_secrets.sh and 05_configure_services.sh to default to 'yes' for user actions regarding domain and email confirmation, as well as n8n worker updates. This change aims to streamline user interactions and reduce the need for repeated confirmations.
2025-11-09 13:48:00 -07:00
Yury Kossakovsky
5b0d701734 Add Docling service configuration and credentials
- Introduced Docling hostname and credentials in .env.example for environment setup.
- Updated Caddyfile to include reverse proxy configuration for the Docling service.
- Added Docling service definition in docker-compose.yml with necessary environment variables and health checks.
- Enhanced README.md to document Docling integration and access details.
- Updated scripts to generate Docling credentials and include them in the final report for user visibility.
2025-11-09 13:38:09 -07:00
Yury Kossakovsky
702d50e90b Add CLAUDE.md for project documentation and remove obsolete workflow files
- Created CLAUDE.md to provide comprehensive guidance on the n8n-install project, including architecture, key files, common commands, and service addition workflow.
- Deleted outdated workflow files: Local_RAG_AI_Agent_n8n_Workflow.json, Create_Google_Doc.json, Get_Postgres_Tables.json, Post_Message_to_Slack.json, and Summarize_Slack_Conversation.json to streamline the repository and remove unused resources.
- Updated final report script to reflect changes in user messaging.
2025-11-05 10:22:52 -07:00
Yury Kossakovsky
0c2b27c2e6 Update PostgreSQL image version and adjust volume mapping in docker-compose.yml
- Changed PostgreSQL image version to 17 for consistency with the latest features.
- Updated volume mapping to specify the data directory for better data management.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
2ac966908d Update PostgreSQL image syntax and add TODO for volume renaming
- Modified the PostgreSQL image definition in docker-compose.yml to use a more robust syntax for the version variable.
- Added a TODO comment in docker-compose.yml to rename the volume for clarity in future updates.
- Simplified the service selection wizard in 04_wizard.sh by removing unnecessary dynamic sizing calculations.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
92db912ee3 Update PostgreSQL image version and enhance wizard dialog sizing
- Changed PostgreSQL image version in docker-compose.yml to use the latest tag for improved compatibility.
- Enhanced the service selection wizard in 04_wizard.sh to dynamically adjust dialog size based on terminal dimensions, ensuring better usability.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
75fc090a22 Update LightRAG service description and adjust wizard display size
- Modified the LightRAG service description in the wizard script for clarity.
- Increased the display size in the service selection wizard to accommodate longer descriptions.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
ff500cdf7b Update PostgreSQL version and improve healthcheck formatting in docker-compose.yml
- Updated PostgreSQL image version from 17 to 18 for the latest features and security improvements.
- Adjusted volume mapping for PostgreSQL to ensure proper data storage.
- Reformatted healthcheck commands for Elasticsearch and RAGFlow services for better readability.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
da6ea89432 Integrate Elasticsearch support into RAGFlow configuration
- Updated .env.example to include RAGFLOW_ELASTICSEARCH_PASSWORD for Elasticsearch credentials.
- Modified docker-compose.yml to replace the Infinity service with a new ragflow-elasticsearch service, including necessary environment variables and health checks.
- Adjusted README.md to reflect the integration of Elasticsearch as the backend for RAGFlow.
- Enhanced system preparation script to configure vm.max_map_count for Elasticsearch requirements.
- Updated secrets generation script to include RAGFLOW_ELASTICSEARCH_PASSWORD for credential management.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
fba8f96b81 Add LightRAG service configuration and credentials
- Introduced LightRAG hostname and credentials in .env.example for environment setup.
- Updated Caddyfile to include reverse proxy configuration for LightRAG service.
- Added LightRAG service definition in docker-compose.yml with necessary environment variables and volume mappings.
- Enhanced README.md to document LightRAG integration and access details.
- Updated scripts to generate LightRAG credentials and include them in the final report for user visibility.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
c68c419fed Update MinIO configuration in docker-compose.yml
- Changed environment variable names from MINIO_ACCESS_KEY and MINIO_SECRET_KEY to MINIO_USER and MINIO_PASSWORD for clarity and consistency in service configuration.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
c8838f0e03 Remove RAGFlow Admin configuration from .env.example, Caddyfile, docker-compose.yml, and final report script
- Deleted RAGFLOW_ADMIN_HOSTNAME from .env.example for environment variable cleanup.
- Removed the RAGFlow Admin reverse proxy block from Caddyfile to simplify routing.
- Excluded RAGFLOW_ADMIN_HOSTNAME from docker-compose.yml to streamline service configuration.
- Updated final report script to omit admin host information for clarity.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
4bb4782c63 Add Nginx configuration for RAGFlow service in docker-compose.yml
- Introduced a new Nginx configuration file to handle static file serving and API request routing.
- Updated docker-compose.yml to mount the Nginx configuration for the RAGFlow service, ensuring proper reverse proxy setup and static asset management.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
2a8fdbd5d7 Update RAGFlow reverse proxy ports in Caddyfile for correct routing
- Changed reverse proxy ports for RAGFlow and RAGFlow Admin from 9380 and 9381 to 80 for simplified configuration and consistency.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
6b42359dfb Update RAGFlow service configuration in docker-compose.yml
- Added a new volume 'ragflow_data' for persistent storage.
- Updated RAGFlow image tag to 'latest' for the most recent version.
- Configured volume mapping for RAGFlow to ensure data persistence.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
e551756a9f Add RAGFlow Admin hostname configuration and update related files
- Added RAGFLOW_ADMIN_HOSTNAME to .env.example for environment variable consistency.
- Updated Caddyfile to use the new RAGFLOW_ADMIN_HOSTNAME for the admin reverse proxy.
- Included RAGFLOW_ADMIN_HOSTNAME in docker-compose.yml to ensure proper service configuration.
- Modified final report script to display the admin host information for better visibility.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
a3bae6855e Add RAGFlow Admin reverse proxy configuration to Caddyfile
- Introduced a new reverse proxy for RAGFlow Admin on port 9381 to facilitate admin access.
- Ensured proper routing for the admin interface alongside the existing RAGFlow service.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
a6a10041ab Update RAGFlow reverse proxy port in Caddyfile to 9380 for correct service routing 2025-11-05 10:18:35 -07:00
Yury Kossakovsky
430a6e3c9a Add Redis service configuration and update environment variables in docker-compose.yml
- Introduced a new Redis service (ragflow-redis) in docker-compose.yml for enhanced caching capabilities.
- Updated environment variables to include RAGFLOW_REDIS_PASSWORD for secure access.
- Modified .env.example to reflect the addition of Redis credentials.
- Updated secrets generation script to include RAGFLOW_REDIS_PASSWORD for consistency in credential management.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
16db24316e Update MySQL database name in docker-compose.yml for consistency
- Changed MYSQL_DATABASE environment variable from 'ragflow' to 'rag_flow' for improved clarity and consistency across services.
- Added REDIS_PASSWORD environment variable to enhance security configuration.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
37a2acd0e2 Update Infinity service configuration in docker-compose.yml
- Changed service dependency condition from 'service_healthy' to 'service_started' for improved startup reliability.
- Updated Infinity service image tag to v0.6.2 for enhanced stability.
- Removed health check configuration and unnecessary port mapping, while adding ulimits for file descriptor limits.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
b4d4b14f5b Update Infinity service image tag to v0.6.0 and adjust health check URL in docker-compose.yml for compatibility improvements. 2025-11-05 10:18:35 -07:00
Yury Kossakovsky
1e38e8c05e Remove command definition for Infinity service in docker-compose.yml to streamline configuration. 2025-11-05 10:18:35 -07:00
Yury Kossakovsky
0cae88f286 Update Infinity service image tag in docker-compose.yml to v0.6.2 for improved stability and compatibility. 2025-11-05 10:18:35 -07:00
Yury Kossakovsky
6f54cbb777 Add Infinity service configuration to docker-compose.yml
- Introduced a new service definition for Infinity, including image, container name, restart policy, and command.
- Configured health checks and environment variables for the Infinity service.
- Added a new volume for Infinity data storage to ensure persistent data management.
- Updated service dependencies to include health checks for proper startup order.
2025-11-05 10:18:35 -07:00