Commit Graph

80 Commits

Author SHA1 Message Date
Yury Kossakovsky
88575aaa43 Enhance docker_cleanup.sh with logging and error handling
- Added error handling with 'set -e' to ensure the script exits on errors.
- Integrated logging functions for starting and completing the Docker cleanup process, improving visibility and tracking of script execution.
2025-08-06 10:43:09 -06:00
Yury Kossakovsky
4863f44c6e Add Docker cleanup script and update README
- Introduced a new script, docker_cleanup.sh, for cleaning up unused Docker containers, images, and volumes to free up disk space.
- Updated README.md to include instructions for using the Docker cleanup script, emphasizing its utility and caution regarding data removal.
2025-08-06 10:41:09 -06:00
Yury Kossakovsky
e05c1c8916 Add system package update step in update.sh script
- Implemented a check to update Ubuntu packages using apt-get before executing the apply_update process. This ensures the system is up-to-date, enhancing the overall update procedure. Added logging for successful updates and warnings for non-Debian systems.
2025-08-06 10:34:07 -06:00
Yury Kossakovsky
c3246e4365 Add functionality to retrieve all profiles from docker-compose file
- Introduced a new function, get_all_profiles, to extract profile names from the docker-compose.yml file.
- Updated the stop_existing_containers function to include all profiles when stopping services, ensuring a comprehensive shutdown of all relevant containers.
- Added the yaml module to handle YAML file parsing.
- Updated system preparation script to install python3-yaml package for YAML support.
2025-07-02 10:07:03 -06:00
Yury Kossakovsky
50d83ccd24 Remove Logflare API key generation from secrets script as tokens are not in use 2025-06-24 10:04:21 -06:00
Yury Kossakovsky
fab66a259a Enhance Qdrant reporting in final report script
- Added output for Qdrant host and API key in the final report script to improve visibility of configuration details.
- Ensured default values are displayed when environment variables are not set, aiding in troubleshooting and setup clarity.
2025-06-18 09:59:12 -06:00
Yury Kossakovsky
ba63036630 Add Qdrant configuration to environment and Caddyfile
- Introduced QDRANT_API_KEY and QDRANT_HOSTNAME to .env.example for required configuration.
- Updated Caddyfile to include reverse proxy settings for Qdrant service.
- Modified docker-compose.yml to set QDRANT__SERVICE__API_KEY environment variable and adjusted service hostname.
- Enhanced secret generation script to include QDRANT_API_KEY for better integration.
2025-06-17 14:28:23 -06:00
Yury Kossakovsky
876fdce2ba Update secret generation script to reflect non-use of Logflare tokens and improve value handling
- Changed LOGFLARE_PRIVATE_ACCESS_TOKEN and LOGFLARE_PUBLIC_ACCESS_TOKEN to indicate "not-in-use" status, clarifying their role in the script.
- Enhanced logic to only pre-populate generated values with non-empty entries from existing environment variables, improving the handling of user inputs during secret generation.
2025-06-06 11:54:38 -06:00
Yury Kossakovsky
6315c972b7 Add Logflare access tokens to secret generation script
- Introduced LOGFLARE_PRIVATE_ACCESS_TOKEN and LOGFLARE_PUBLIC_ACCESS_TOKEN to the secret generation script, allowing for better integration with Supabase.
- Updated logic to preserve empty values from existing environment variables, ensuring comprehensive handling of user inputs during secret generation.
2025-06-06 11:35:37 -06:00
Yury Kossakovsky
cbf30fc27b Refactor n8n import logic in secret generation script
- Removed the RUN_N8N_IMPORT_COMPLETE variable from .env.example and the associated logic in 03_generate_secrets.sh to simplify the import process for n8n workflows.
- Streamlined user prompts for importing workflows, ensuring a more straightforward decision-making process during script execution.
2025-05-30 15:25:45 -06:00
Yury Kossakovsky
e38490cfd7 Add monitoring service to base services data in wizard script
- Included the monitoring service entry in the base_services_data array of 04_wizard.sh, enhancing the service orchestration options available to users.
- Removed the duplicate entry for the monitoring service to streamline the configuration.
2025-05-28 22:14:40 -06:00
Yury Kossakovsky
ddee8a18cd Refine n8n import decision logic in secret generation script
- Updated the logic in 03_generate_secrets.sh to clarify the conditions under which the n8n import decision is made.
- Ensured that the import status is always marked as complete for future runs after user interaction, improving the script's usability and consistency.
2025-05-28 21:54:09 -06:00
Yury Kossakovsky
0a6d0b1a96 Enhance Neo4j reporting in final report script
- Updated the output in 06_final_report.sh to provide clearer information about Neo4j configuration, including Web UI host, Bolt port, and HTTP API access details.
- Improved formatting for better readability and user guidance on authentication and API usage.
2025-05-28 21:50:50 -06:00
Yury Kossakovsky
296f559a3b Enhance email and OpenAI API key prompts in secret generation script
- Added conditional checks to ensure prompts for user email and OpenAI API key are only displayed if the respective environment variables are not set, improving user experience and preventing unnecessary input requests.
2025-05-28 19:16:19 -06:00
Yury Kossakovsky
3833595172 Fix empty 'then' block in OpenAI API Key check in secret generation script
- Added a null command to the 'then' block of the OpenAI API Key check in 03_generate_secrets.sh to prevent syntax errors and improve script stability.
2025-05-28 19:07:12 -06:00
Yury Kossakovsky
9811265a12 Refactor logging in secret generation and wizard scripts
- Removed unnecessary log_info statements in 03_generate_secrets.sh to reduce clutter and improve readability.
- Updated 04_wizard.sh by removing a log_info statement related to setting COMPOSE_PROFILES, streamlining the output during configuration.
2025-05-28 19:01:35 -06:00
Yury Kossakovsky
5ef17de012 Remove Weaviate password handling from configuration files and scripts
- Eliminated WEAVIATE_PASSWORD and WEAVIATE_PASSWORD_HASH from .env.example, Caddyfile, Docker Compose, and the secret generation script to enhance security by avoiding plaintext password exposure.
- Updated related scripts to reflect the removal of Weaviate password management, ensuring a streamlined configuration.
2025-05-28 18:53:53 -06:00
Yury Kossakovsky
4d882c3bc9 Add Neo4j username handling in secret generation script
- Introduced NEO4J_AUTH_USERNAME variable to manage Neo4j username in the secret generation process.
- Updated user input variable list and logic to accommodate the new username variable, ensuring proper handling in the .env file.
2025-05-28 18:40:51 -06:00
Yury Kossakovsky
9b77ffb6db Add functions for environment variable management and password hashing in secret generation script
- Introduced _update_or_add_env_var function to streamline updating or adding variables in the .env file.
- Added _generate_and_get_hash function to handle password hashing using Caddy, improving security for sensitive data.
- Refactored logic for generating and storing password hashes for Prometheus, SearXNG, and Weaviate, ensuring consistent handling and updates in the .env file.
2025-05-28 17:27:28 -06:00
Yury Kossakovsky
597d43ec3c Refactor secret generation script to improve variable management
- Moved the declaration of the generated_values associative array to a more appropriate location in 03_generate_secrets.sh for better organization.
- Removed redundant declaration of generated_values to streamline the script's logic and enhance readability.
2025-05-28 17:13:46 -06:00
Yury Kossakovsky
47cfef0698 Implement n8n workflow import logic in secret generation script
- Added RUN_N8N_IMPORT_COMPLETE variable to .env.example to track the completion status of n8n workflow imports.
- Updated 03_generate_secrets.sh to manage user prompts for importing workflows and preserve the import status across sessions.
- Refined the logic for determining whether to prompt the user for importing workflows based on previous completion status.
2025-05-28 17:08:21 -06:00
Yury Kossakovsky
93ab91f392 Enhance domain name handling in secret generation script
- Added USER_DOMAIN_NAME variable to .env.example for user-defined domain configuration.
- Updated 03_generate_secrets.sh to improve domain input handling, including validation and user prompts.
- Simplified the process of retrieving and confirming the primary domain name for services.
2025-05-28 16:57:45 -06:00
Yury Kossakovsky
3139ca54de Refactor logging messages in scripts for clarity
- Removed redundant log message in 04_wizard.sh related to COMPOSE_PROFILES.
- Updated success messages in apply_update.sh for improved readability and conciseness.
2025-05-28 16:45:52 -06:00
Yury Kossakovsky
c10e8df0a3 Update environment configuration and enhance logging in scripts
- Added COMPOSE_PROFILES variable to .env.example for better service profile management.
- Enhanced logging in 04_wizard.sh to provide clearer information on the read COMPOSE_PROFILES value.
- Updated apply_update.sh to improve success messages and removed redundant service stopping logic for clarity.
2025-05-27 20:49:41 -06:00
Yury Kossakovsky
6797dbb5c3 Enhance Weaviate configuration in docker-compose and secret generation script
- Added Weaviate username and password hash environment variables to docker-compose.yml for improved security and configuration.
- Updated 03_generate_secrets.sh to better handle existing environment variables and ensure proper initialization of the .env file.
2025-05-27 16:25:47 -06:00
Yury Kossakovsky
9ba99a33b4 Update Neo4j username handling in configuration files
- Set default Neo4j username in .env.example for easier configuration.
- Removed dynamic assignment of Neo4j username in 03_generate_secrets.sh to streamline secret generation.
- Updated user input variable list to reflect the changes in Neo4j username handling.
2025-05-27 15:58:07 -06:00
Yury Kossakovsky
fa9c52af3e Update configuration files to enhance Weaviate and Neo4j integration
- Added Weaviate username, password, and API key placeholders to .env.example.
- Updated Caddyfile to include Prometheus reverse proxy settings.
- Enhanced docker-compose.yml with health checks and ulimits for Neo4j service.
- Modified scripts to include Neo4j in the service selection and final report outputs.
2025-05-27 14:45:07 -06:00
Yury Kossakovsky
50e6725b2e Add Neo4j service configuration and update related files
- Introduced Neo4j service in docker-compose.yml with necessary environment variables and volume mappings.
- Updated Caddyfile to include reverse proxy settings for Neo4j.
- Enhanced .env.example to include placeholders for Neo4j username and password.
- Modified README.md to document Neo4j integration and access details.
- Added .cursorignore file to specify files and directories to ignore during indexing.
2025-05-27 14:23:01 -06:00
Yury Kossakovsky
3c9a39d446 Enhance domain input handling in 03_generate_secrets.sh and update apply_update.sh
- Introduced logic to infer the current domain from N8N_HOSTNAME or SUPABASE_HOSTNAME for user prompts in 03_generate_secrets.sh.
- Improved user prompts to display the current domain as a default suggestion, enhancing user experience.
- Updated apply_update.sh to ensure the .env file is checked and updated by calling 03_generate_secrets.sh during the update process.
2025-05-24 10:15:04 -06:00
Yury Kossakovsky
c343d2c1e9 Add Weaviate service configuration and update documentation
- Introduced Weaviate service in docker-compose.yml with necessary environment variables and health checks.
- Updated Caddyfile to include reverse proxy settings for Weaviate with basic authentication.
- Enhanced README.md to document Weaviate's integration and access details.
- Modified scripts to generate secrets for Weaviate, including username and password handling.
- Updated final report script to display Weaviate configuration details for user clarity.
2025-05-24 09:41:14 -06:00
Yury Kossakovsky
ab7997a4ca Remove redundant log messages in scripts for improved clarity
- Eliminated unnecessary log_info statements in 03_generate_secrets.sh, 06_final_report.sh, and apply_update.sh to streamline output and enhance readability.
- Adjusted echo statements in 06_final_report.sh to maintain focus on essential information without clutter.
2025-05-23 17:37:27 -06:00
Yury Kossakovsky
eeb19f590f Refactor logging and user prompts in installation and wizard scripts
- Enhanced user feedback by replacing echo statements with log_info and log_error for better consistency in logging.
- Added empty echo statements before user prompts in 03_generate_secrets.sh to improve readability.
- Removed unnecessary log messages related to Caddy installation and uninstallation in 03_generate_secrets.sh.
- Updated 04_wizard.sh to include utility sourcing and improved logging for service selection and profile updates.
- Streamlined apply_update.sh by removing redundant log messages regarding Supabase compose file checks.
2025-05-23 15:05:23 -06:00
Yury Kossakovsky
3fd4cc9c23 Update Qdrant service configuration in docker-compose.yml and final_report.sh
- Removed comments for gRPC and HTTP REST API ports in docker-compose.yml to simplify the configuration.
- Corrected the internal REST API access message in final_report.sh to reflect the updated port usage, ensuring clarity in service access instructions.
2025-05-22 17:52:51 -06:00
Yury Kossakovsky
1db81b35da Update Supabase reporting in final_report.sh to enhance clarity
- Removed detailed PostgreSQL connection information to streamline output.
- Added Service Role Secret to provide necessary context for Supabase configuration.
- Improved overall readability of the Supabase section in the final report.
2025-05-22 17:38:37 -06:00
Yury Kossakovsky
6cd3eb7927 Refactor apply_update.sh to streamline service update process
- Removed redundant service selection wizard invocation from the pull section, ensuring it runs first to update service choices.
- Enhanced logging messages for clarity regarding the Supabase compose file inclusion and Docker image pulling.
- Improved error handling for the service selection wizard failure, preventing continuation of the update process if it fails.
2025-05-22 14:19:28 -06:00
Yury Kossakovsky
5eae1e4872 Remove container removal command from apply_update.sh for 'localai' project to streamline shutdown process and improve error handling. 2025-05-22 14:11:08 -06:00
Yury Kossakovsky
f5aa8a5ddf Refactor service management in start_services.py and scripts
- Updated the is_supabase_enabled function to read COMPOSE_PROFILES from the .env file instead of os.environ, improving clarity.
- Simplified the run_command function by removing the unused env parameter.
- Refined the stop_existing_containers function to streamline the shutdown process for the 'localai' project, conditionally including the Supabase compose file.
- Enhanced logging for better user feedback during service management operations.
- Adjusted the scripts for generating secrets and applying updates to improve clarity and functionality.
2025-05-22 14:09:28 -06:00
Yury Kossakovsky
394e4669eb Refactor installation summary logging in final report generation
- Moved the installation summary logging from 06_final_report.sh to install.sh to ensure it is displayed immediately after the installation steps.
- Improved the organization of the final report generation process by consolidating related logging functionality.
- Enhanced user visibility of installation steps performed during the setup process.
2025-05-22 11:34:45 -06:00
Yury Kossakovsky
8c017549f2 Add final report display in apply_update.sh to show service credentials
- Implemented a final report display feature in apply_update.sh to show service credentials post-update.
- Added error handling to log a warning if the final report fails to display, ensuring the update process remains unaffected.
- Enhanced user experience by providing a summary of service credentials after a successful update.
2025-05-22 11:29:09 -06:00
Yury Kossakovsky
2baafa495b Refactor service selection in wizard script and integrate into update process
- Updated the service selection logic in 04_wizard.sh to dynamically populate available services based on current COMPOSE_PROFILES from the .env file.
- Enhanced the Ollama hardware profile selection to reflect user choices and defaults based on existing profiles.
- Integrated the service selection wizard into apply_update.sh to streamline the update process and ensure user-defined service configurations are applied.
- Improved user prompts and handling for service choices, enhancing overall configuration experience.
2025-05-22 11:27:45 -06:00
Yury Kossakovsky
ae5cd1aab2 Enhance n8n import handling in apply_update.sh and update secrets generation
- Added logic to determine the N8N_WORKFLOWS_IMPORTED_EVER variable based on existing environment values and user input.
- Updated the apply_update.sh script to check if workflows have been imported previously, modifying the RUN_N8N_IMPORT and N8N_WORKFLOWS_IMPORTED_EVER variables accordingly.
- Improved user prompts for importing n8n workflows, ensuring a smoother configuration experience.
2025-05-22 11:22:11 -06:00
Yury Kossakovsky
5d1e46430c Add PostgreSQL configuration for n8n and Langfuse in final report script
- Enhanced the final report script to include details for a standalone PostgreSQL instance used by n8n and Langfuse.
- Added Ollama service information for internal access based on active profiles.
- Clarified the distinction between Supabase's internal PostgreSQL and the standalone instance for better user understanding.
2025-05-15 20:48:32 -06:00
Yury Kossakovsky
d2abd6e036 Add Ollama service configuration to docker-compose.yml and update related files
- Introduced Ollama service with CPU and GPU profiles in docker-compose.yml, allowing users to run large language models locally.
- Added Ollama selection option in the wizard script for hardware profile configuration.
- Updated README.md to include Ollama as a new available service.
- Adjusted .env.example to include GRAFANA_HOSTNAME in the correct position.
2025-05-15 20:44:36 -06:00
Yury Kossakovsky
09a369a5d2 Enhance TMP_ENV_FILE handling in 03_generate_secrets.sh
- Added a check to prevent duplicate entries when appending environment variables to TMP_ENV_FILE, ensuring cleaner and more efficient script execution.
2025-05-15 19:54:17 -06:00
Yury Kossakovsky
0098378fd7 Refactor install.sh to streamline utilities sourcing
- Moved the sourcing of the utilities file to the beginning of the script for better organization and clarity.
- Removed redundant sourcing of the utilities file from the middle of the script.
2025-05-15 19:46:01 -06:00
Yury Kossakovsky
1da5d2851c Implement nested n8n-installer directory check in install.sh
- Added logic to detect and correct nested n8n-installer directory structures.
- Included re-execution of the install script from the corrected path to ensure proper script execution and path resolution.
2025-05-15 19:24:14 -06:00
Yury Kossakovsky
c3076a9990 Add Letta service configuration and update documentation
- Added Letta service to docker-compose.yml with necessary environment variables and volume configuration.
- Updated Caddyfile to include reverse proxy for Letta.
- Included Letta in the README.md for service availability and provided a brief description.
- Enhanced scripts to generate Letta server password and report its status in the final report.
- Updated .env.example to include Letta hostname and server password variable.
2025-05-15 19:11:33 -06:00
Yury Kossakovsky
0bada5dde9 Remove logging of current n8n worker count in apply_update.sh to streamline user prompts and enhance clarity during input collection. 2025-05-14 14:41:07 -06:00
Yury Kossakovsky
cd866edbdd Improve user prompts in 03_generate_secrets.sh and apply_update.sh
- Standardized prompt formatting by removing unnecessary newline characters, enhancing clarity and consistency in user interactions.
- Updated prompts to ensure a more straightforward user experience during input collection, particularly for domain name, email, and n8n worker count inputs.
2025-05-14 14:37:55 -06:00
Yury Kossakovsky
61ebcc8982 Refine n8n workflow import prompt in apply_update.sh
- Updated the user prompt to clarify the response options for importing n8n workflows, enhancing user understanding and interaction.
- Ensured consistency in prompt formatting across the script for improved user experience.
2025-05-14 14:35:57 -06:00