Commit Graph

155 Commits

Author SHA1 Message Date
Yury Kossakovsky
35ca31d1af fix: address n8n v2.0 migration review issues
- fix quote parsing in N8N_WORKER_COUNT from .env
- remove unused N8N_RUNNER_COUNT references
- parameterize n8n version for both n8n and runner images
- add healthchecks to n8n main and worker services
2025-12-11 11:39:01 -07:00
Yury Kossakovsky
62089b0b4b docs: document worker-runner sidecar architecture
update CLAUDE.md with sidecar pattern details including dynamic
generation, network mode, and scaling instructions. add worker
count and architecture info to final installation report.
2025-12-11 11:39:01 -07:00
Yury Kossakovsky
98f2dd807e refactor: integrate worker-runner generation into install/update flow
update configure services to call generate_n8n_workers.sh instead of
prompting for separate runner count. update start_services.py and
apply_update.sh to include docker-compose.n8n-workers.yml when present.
2025-12-11 11:39:01 -07:00
Yury Kossakovsky
d54eca620c feat: implement worker-runner sidecar pattern for n8n
replace replicated workers/runners with dynamically generated 1:1
worker-runner pairs where each runner connects to its worker via
localhost (network_mode: service). this improves task routing by
ensuring each worker has dedicated runner capacity.

add generate_n8n_workers.sh script to create docker-compose.n8n-workers.yml
2025-12-11 11:39:01 -07:00
Yury Kossakovsky
638c3d17a6 feat: add n8n v2.0 external task runner support
upgrade n8n from 1.123.3 to 2.0.0-rc.4 with external task runners for
Code node execution. task runners handle javascript and python code
execution in isolated containers with configurable concurrency.

key changes:
- add n8n-runner service using n8nio/runners:2.0.0-rc.4
- configure runner auth token and broker communication
- add N8N_RUNNER_COUNT for scaling runner replicas
- move code node library config to runner container
- update binary data mode from filesystem to database
- add runner count prompt to installation wizard
2025-12-11 11:39:01 -07:00
Yury Kossakovsky
ac13c400f5 feat(docling): add vlm pipeline configuration and usage instructions
add environment variables for vlm pipeline support (remote services,
model loading, device selection) and persistent cache volume. improve
final report with detailed vlm pipeline usage example showing how to
use ollama with granite3.2-vision model for document conversion.
2025-11-26 17:32:09 -07:00
Yury Kossakovsky
761200adbc Refactor healthcheck command format in docker-compose.yml and standardize PostgreSQL host output in final report script
- Updated the healthcheck command in docker-compose.yml for improved readability by formatting it as a list.
- Standardized the output for PostgreSQL host in 07_final_report.sh to remove environment variable references, ensuring consistent messaging.
2025-11-12 23:13:00 -07:00
Yury Kossakovsky
ba81e717e2 Refactor Docling final report output for clarity and consistency
- Updated the final report script to streamline the output for the Docling service by reorganizing the displayed information.
- Removed redundant lines and ensured that essential details such as API endpoints and user credentials are clearly presented.
2025-11-09 14:24:38 -07:00
Yury Kossakovsky
bb3c6b4810 Update confirmation prompts in secret generation and service configuration scripts to default to 'yes'
- Modified the confirmation prompts in 03_generate_secrets.sh and 05_configure_services.sh to default to 'yes' for user actions regarding domain and email confirmation, as well as n8n worker updates. This change aims to streamline user interactions and reduce the need for repeated confirmations.
2025-11-09 13:48:00 -07:00
Yury Kossakovsky
5b0d701734 Add Docling service configuration and credentials
- Introduced Docling hostname and credentials in .env.example for environment setup.
- Updated Caddyfile to include reverse proxy configuration for the Docling service.
- Added Docling service definition in docker-compose.yml with necessary environment variables and health checks.
- Enhanced README.md to document Docling integration and access details.
- Updated scripts to generate Docling credentials and include them in the final report for user visibility.
2025-11-09 13:38:09 -07:00
Yury Kossakovsky
702d50e90b Add CLAUDE.md for project documentation and remove obsolete workflow files
- Created CLAUDE.md to provide comprehensive guidance on the n8n-install project, including architecture, key files, common commands, and service addition workflow.
- Deleted outdated workflow files: Local_RAG_AI_Agent_n8n_Workflow.json, Create_Google_Doc.json, Get_Postgres_Tables.json, Post_Message_to_Slack.json, and Summarize_Slack_Conversation.json to streamline the repository and remove unused resources.
- Updated final report script to reflect changes in user messaging.
2025-11-05 10:22:52 -07:00
Yury Kossakovsky
2ac966908d Update PostgreSQL image syntax and add TODO for volume renaming
- Modified the PostgreSQL image definition in docker-compose.yml to use a more robust syntax for the version variable.
- Added a TODO comment in docker-compose.yml to rename the volume for clarity in future updates.
- Simplified the service selection wizard in 04_wizard.sh by removing unnecessary dynamic sizing calculations.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
92db912ee3 Update PostgreSQL image version and enhance wizard dialog sizing
- Changed PostgreSQL image version in docker-compose.yml to use the latest tag for improved compatibility.
- Enhanced the service selection wizard in 04_wizard.sh to dynamically adjust dialog size based on terminal dimensions, ensuring better usability.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
75fc090a22 Update LightRAG service description and adjust wizard display size
- Modified the LightRAG service description in the wizard script for clarity.
- Increased the display size in the service selection wizard to accommodate longer descriptions.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
da6ea89432 Integrate Elasticsearch support into RAGFlow configuration
- Updated .env.example to include RAGFLOW_ELASTICSEARCH_PASSWORD for Elasticsearch credentials.
- Modified docker-compose.yml to replace the Infinity service with a new ragflow-elasticsearch service, including necessary environment variables and health checks.
- Adjusted README.md to reflect the integration of Elasticsearch as the backend for RAGFlow.
- Enhanced system preparation script to configure vm.max_map_count for Elasticsearch requirements.
- Updated secrets generation script to include RAGFLOW_ELASTICSEARCH_PASSWORD for credential management.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
fba8f96b81 Add LightRAG service configuration and credentials
- Introduced LightRAG hostname and credentials in .env.example for environment setup.
- Updated Caddyfile to include reverse proxy configuration for LightRAG service.
- Added LightRAG service definition in docker-compose.yml with necessary environment variables and volume mappings.
- Enhanced README.md to document LightRAG integration and access details.
- Updated scripts to generate LightRAG credentials and include them in the final report for user visibility.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
c8838f0e03 Remove RAGFlow Admin configuration from .env.example, Caddyfile, docker-compose.yml, and final report script
- Deleted RAGFLOW_ADMIN_HOSTNAME from .env.example for environment variable cleanup.
- Removed the RAGFlow Admin reverse proxy block from Caddyfile to simplify routing.
- Excluded RAGFLOW_ADMIN_HOSTNAME from docker-compose.yml to streamline service configuration.
- Updated final report script to omit admin host information for clarity.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
e551756a9f Add RAGFlow Admin hostname configuration and update related files
- Added RAGFLOW_ADMIN_HOSTNAME to .env.example for environment variable consistency.
- Updated Caddyfile to use the new RAGFLOW_ADMIN_HOSTNAME for the admin reverse proxy.
- Included RAGFLOW_ADMIN_HOSTNAME in docker-compose.yml to ensure proper service configuration.
- Modified final report script to display the admin host information for better visibility.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
430a6e3c9a Add Redis service configuration and update environment variables in docker-compose.yml
- Introduced a new Redis service (ragflow-redis) in docker-compose.yml for enhanced caching capabilities.
- Updated environment variables to include RAGFLOW_REDIS_PASSWORD for secure access.
- Modified .env.example to reflect the addition of Redis credentials.
- Updated secrets generation script to include RAGFLOW_REDIS_PASSWORD for consistency in credential management.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
48414607fd Refactor RAGFlow service configuration in docker-compose.yml and system preparation script
- Removed Elasticsearch service configuration from docker-compose.yml, simplifying the setup.
- Updated RAGFlow service to use the latest image tag for better compatibility.
- Changed environment variable from ES_HOST and ES_PORT to DOC_ENGINE for improved clarity.
- Removed vm.max_map_count configuration from the system preparation script, as it is no longer necessary for RAGFlow.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
bf5575a48f Add RAGFlow service configuration and documentation
- Updated .env.example to include RAGFlow hostname and internal credentials for MySQL and MinIO.
- Modified Caddyfile to set up a reverse proxy for RAGFlow service.
- Enhanced docker-compose.yml with RAGFlow service definition, including environment variables and health checks for dependencies.
- Updated README.md to include RAGFlow information and service URL for user guidance.
- Configured system preparation script to set vm.max_map_count for Elasticsearch support required by RAGFlow.
- Added secret generation for RAGFlow internal credentials in the secrets generation script.
- Included RAGFlow in the final report script for visibility on service status and access information.
2025-11-05 10:18:35 -07:00
Yury Kossakovsky
1e2636d3bf Update documentation and scripts for n8n installation
- Renamed references from "n8n-installer" to "n8n-install" across multiple files for consistency.
- Improved formatting in Cloudflare instructions for better readability.
- Updated installation script to handle directory corrections for the new naming convention.
- Adjusted service selection script comments to reflect the updated project name.
2025-11-05 10:17:32 -07:00
Yury Kossakovsky
d0ac21a20b Update WAHA service configuration in docker-compose.yml and README.md
- Modified docker-compose.yml to use environment variables for WAHA_DASHBOARD_ENABLED and WHATSAPP_SWAGGER_ENABLED, allowing for more flexible configuration.
- Added service health dependencies for Redis and Postgres in docker-compose.yml to ensure proper service startup order.
- Updated README.md to include WAHA service URL for better user guidance.
2025-10-15 19:22:50 -06:00
Yury Kossakovsky
5429ba4324 Add WAHA configuration updates to .env.example and docker-compose.yml
- Introduced WAHA_PUBLIC_URL in .env.example for external access configuration.
- Enhanced docker-compose.yml with additional environment variables for WAHA service, including WAHA_DASHBOARD_ENABLED and WHATSAPP_SESSIONS_POSTGRESQL_URL.
- Updated final report script to reflect changes in WAHA service URLs for improved visibility.
2025-10-15 13:06:06 -06:00
Yury Kossakovsky
fd96208619 Refactor WAHA API key generation in 03_generate_secrets.sh to ensure it occurs after .env write/substitutions. This change prevents overwriting existing values and maintains the integrity of generated secrets. 2025-10-15 12:51:12 -06:00
Yury Kossakovsky
5037bc6d16 Add WAHA (WhatsApp HTTP API) configuration to project
- Updated .env.example to include WAHA_HOSTNAME and related environment variables for configuration.
- Modified Caddyfile to set up reverse proxy for WAHA service.
- Enhanced docker-compose.yml to define WAHA service with necessary environment variables.
- Updated scripts to generate secrets for WAHA, including dashboard and Swagger credentials.
- Added WAHA information to the final report for user visibility.
2025-10-15 11:45:04 -06:00
Yury Kossakovsky
d31dbc1d0e Implement mutual exclusivity check for Dify and Supabase in wizard script
- Added logic to enforce that only one of Dify or Supabase can be selected by the user.
- Introduced a whiptail dialog to prompt the user to choose which service to keep if both are selected.
- Updated the selected_profiles array accordingly and logged the action for clarity.
2025-09-17 14:22:06 -06:00
Yury Kossakovsky
4d65382e92 Refactor user input prompts in scripts to use whiptail for better UX
- Replaced standard input prompts with whiptail dialogs in 03_generate_secrets.sh and 05_configure_services.sh for domain, email, OpenAI API key, and n8n worker count.
- Added validation messages using whiptail for empty inputs and invalid formats.
- Introduced new utility functions in utils.sh for whiptail integration, ensuring the script checks for whiptail availability.
2025-09-17 14:15:12 -06:00
Yury Kossakovsky
09491c01bf Change file permissions for 04_wizard.sh to make it executable 2025-09-16 19:25:52 -06:00
Yury Kossakovsky
f6bbb22508 Update docker-compose.yml and final report script to improve Redis configuration and reporting
- Changed the default Redis authentication setting in docker-compose.yml to be empty for better flexibility.
- Added a dashboard link to the final report script for easier access to Qdrant's dashboard.
2025-09-02 17:11:20 -06:00
Yury Kossakovsky
30b69350f1 Add POSTGRES_HOST variable to service configuration script
- Introduced a new environment variable, POSTGRES_HOST, to ensure Supabase Analytics targets the correct Postgres service name in the Docker setup.
- This change enhances the accuracy of database connection settings in the service configuration process.
2025-08-29 09:10:08 -06:00
Yury Kossakovsky
898a3e347e Update service status handling in wizard script to include Portainer and Postgresus
- Modified the service status logic in `04_wizard.sh` to set the status to "ON" for Portainer and Postgresus, enhancing service management capabilities.
- This change improves the flexibility of service configurations during the setup process.
2025-08-28 19:58:18 -06:00
Yury Kossakovsky
fc390cb1d5 Refactor service configuration script for enhanced user experience
- Improved the handling of the OpenAI API key prompt, allowing for reuse of existing values and clearer user instructions.
- Streamlined the n8n worker count configuration process with better validation and user feedback.
- Updated Cloudflare Tunnel token handling to check for active profiles before prompting for input.
- Enhanced logging for successful configuration completion, ensuring clarity in the script's execution flow.
2025-08-28 18:56:36 -06:00
Yury Kossakovsky
0396f8bb29 Enhance service configuration script for improved user interaction
- Refactored prompts for OpenAI API key and n8n workflow import settings in `05_configure_services.sh` to streamline user experience.
- Improved validation and handling of n8n worker count input, ensuring robust configuration.
- Added logic to manage Cloudflare Tunnel token input more effectively, reusing existing tokens when available.
- Updated logging for better clarity during configuration steps, enhancing overall maintainability of the script.
2025-08-28 18:47:02 -06:00
Yury Kossakovsky
03a6812ec5 Refactor service configuration scripts and streamline .env updates
- Removed redundant prompts for OpenAI API key and Cloudflare Tunnel token in `03_generate_secrets.sh` and `04_wizard.sh`.
- Introduced `05_configure_services.sh` to handle service configuration and .env updates, improving clarity and maintainability.
- Enhanced user prompts for n8n worker count and workflow import settings, ensuring better user experience during configuration.
- Updated installation script to include the new configuration script, ensuring a cohesive setup process.
2025-08-28 18:42:50 -06:00
Yury Kossakovsky
2b3b602fa7 Refactor service scripts and update final report generation
- Renamed and reorganized service scripts: `05_run_services.sh` is now `06_run_services.sh`, and `06_final_report.sh` is now `07_final_report.sh`.
- Updated references in documentation and other scripts to reflect the new script names.
- Enhanced the final report script to include access details for newly integrated services, ensuring comprehensive output for users.
2025-08-28 18:42:43 -06:00
Yury Kossakovsky
c1ceb1884a Refactor LibreTranslate environment variable names across configuration files
- Updated environment variable names in .env.example, Caddyfile, and docker-compose.yml for consistency and clarity.
- Adjusted the final report script to reflect the new variable names, ensuring accurate output.
- Enhanced the script for generating secrets to accommodate the updated variable names, improving maintainability.
2025-08-28 17:19:30 -06:00
Yury Kossakovsky
fb0a5a3e02 Refactor LibreTranslate configuration in .env.example and docker-compose.yml
- Updated environment variable names in .env.example to align with container environment variables.
- Simplified the docker-compose.yml to use the new variable names, enhancing clarity and maintainability.
- Removed outdated API endpoint documentation from the final report script to streamline output.
2025-08-28 17:18:44 -06:00
Yury Kossakovsky
c0ab4a06ed Merge pull request #15 from freddy-schuetz/feature/libretranslate-upstream
feat: Add LibreTranslate self-hosted translation service
2025-08-28 17:10:10 -06:00
Yury Kossakovsky
68e03b95dc Update PostgreSQL configuration in .env.example and final report script
- Changed POSTGRES_HOST value in .env.example from 'db' to 'postgres' for clarity.
- Enhanced the final report script to display detailed PostgreSQL backup target information, including version, host, port, username, password, and database name.
2025-08-28 11:26:31 -06:00
Yury Kossakovsky
a4f94c85f2 Remove Postgresus credentials and related configurations from .env.example, docker-compose.yml, and scripts as they are no longer needed. This includes the removal of username, password, and password hash entries, streamlining the environment setup. 2025-08-28 11:17:15 -06:00
Yury Kossakovsky
220f008b31 Add Postgresus service configuration and credentials
- Introduced Postgresus service in docker-compose.yml with necessary environment variables and volume configuration.
- Updated .env.example to include Postgresus credentials (username, password, password hash).
- Modified Caddyfile to implement basic authentication for Postgresus.
- Enhanced scripts for secret generation to include Postgresus credentials.
- Updated README.md to add a description for Postgresus and its functionalities.
- Enhanced final report script to display Postgresus connection details if the service is active.
2025-08-28 11:00:12 -06:00
freddy-schuetz
784e7a193a feat: Add LibreTranslate self-hosted translation service
- Add LibreTranslate service with 50+ language support
- Configure with Basic Auth for security
- Integrate with wizard and final report
- Add documentation to README
2025-08-28 16:59:09 +02:00
Yury Kossakovsky
c6442b0fbd Add environment variable for Ollama service in docker-compose.yml and update service descriptions in wizard script
- Added OLLAMA_BASE_URL environment variable to the open-webui service in docker-compose.yml.
- Updated the service descriptions in 04_wizard.sh to include new services and reorganize existing ones for clarity.
2025-08-27 16:04:46 -06:00
Yury Kossakovsky
984ae0a8f7 Add PaddleOCR username to secrets generation script
- Included a new variable for PaddleOCR username in the secrets generation script to align with recent configuration changes.
2025-08-27 15:29:19 -06:00
Yury Kossakovsky
efbf42c2d7 Add PaddleOCR username variable to secrets generation script
- Introduced a new variable for PaddleOCR username in the secrets generation script to support recent configuration updates.
2025-08-27 15:26:00 -06:00
Yury Kossakovsky
c4d08b729b Add PaddleOCR configuration and credentials to environment and Caddyfile
- Updated .env.example to include PaddleOCR credentials (username, password, password hash).
- Modified Caddyfile to implement basic authentication for PaddleOCR using the new credentials.
- Enhanced docker-compose.yml to pass PaddleOCR environment variables to the service.
- Updated scripts to generate and manage PaddleOCR password securely.
- Added PaddleOCR documentation link in README.md for user reference.
2025-08-27 15:11:20 -06:00
Yury Kossakovsky
8f6b5e8e6d Update service selection wizard to dynamically adjust checklist height based on the number of services available 2025-08-27 13:57:43 -06:00
Yury Kossakovsky
f51cda8e20 Enhance service selection wizard and update PaddleOCR details in final report
- Adjusted the service selection wizard to dynamically set the height of the checklist based on the number of services.
- Updated final report script to provide clearer API access information for PaddleOCR, distinguishing between external and internal access.
2025-08-27 13:55:42 -06:00
Yury Kossakovsky
c846f2ae31 Add PaddleOCR service configuration
- Added PaddleOCR hostname to .env.example for environment variable setup.
- Updated Caddyfile to include reverse proxy configuration for PaddleOCR.
- Modified docker-compose.yml to define PaddleOCR service with necessary commands and health checks.
- Enhanced service selection wizard to include PaddleOCR in the options.
- Updated final report script to display PaddleOCR service details if active.
2025-08-27 13:46:02 -06:00