Commit Graph

170 Commits

Author SHA1 Message Date
Yury Kossakovsky
4d882c3bc9 Add Neo4j username handling in secret generation script
- Introduced NEO4J_AUTH_USERNAME variable to manage Neo4j username in the secret generation process.
- Updated user input variable list and logic to accommodate the new username variable, ensuring proper handling in the .env file.
2025-05-28 18:40:51 -06:00
Yury Kossakovsky
06a1b9fb86 Update Caddyfile and Docker Compose for Neo4j integration
- Modified Caddyfile to configure reverse proxy for Neo4j HTTP and Bolt protocols.
- Updated Docker Compose to expose port 7687 for Neo4j Bolt protocol access.
2025-05-28 18:40:45 -06:00
Yury Kossakovsky
d6a00ff889 Update .env.example to include new password hash variables
- Added PROMETHEUS_PASSWORD_HASH, SEARXNG_PASSWORD_HASH, and WEAVIATE_PASSWORD_HASH to .env.example for improved security management of sensitive data.
2025-05-28 17:28:28 -06:00
Yury Kossakovsky
9b77ffb6db Add functions for environment variable management and password hashing in secret generation script
- Introduced _update_or_add_env_var function to streamline updating or adding variables in the .env file.
- Added _generate_and_get_hash function to handle password hashing using Caddy, improving security for sensitive data.
- Refactored logic for generating and storing password hashes for Prometheus, SearXNG, and Weaviate, ensuring consistent handling and updates in the .env file.
2025-05-28 17:27:28 -06:00
Yury Kossakovsky
73d3d57442 Update Docker Compose handling in start_services.py for security compliance
- Modified the cap_drop directive in the Docker Compose configuration to ensure correct multi-line YAML format.
- Added a note to re-enable the cap_drop directive after the first run for enhanced security.
2025-05-28 17:18:11 -06:00
Yury Kossakovsky
597d43ec3c Refactor secret generation script to improve variable management
- Moved the declaration of the generated_values associative array to a more appropriate location in 03_generate_secrets.sh for better organization.
- Removed redundant declaration of generated_values to streamline the script's logic and enhance readability.
2025-05-28 17:13:46 -06:00
Yury Kossakovsky
47cfef0698 Implement n8n workflow import logic in secret generation script
- Added RUN_N8N_IMPORT_COMPLETE variable to .env.example to track the completion status of n8n workflow imports.
- Updated 03_generate_secrets.sh to manage user prompts for importing workflows and preserve the import status across sessions.
- Refined the logic for determining whether to prompt the user for importing workflows based on previous completion status.
2025-05-28 17:08:21 -06:00
Yury Kossakovsky
93ab91f392 Enhance domain name handling in secret generation script
- Added USER_DOMAIN_NAME variable to .env.example for user-defined domain configuration.
- Updated 03_generate_secrets.sh to improve domain input handling, including validation and user prompts.
- Simplified the process of retrieving and confirming the primary domain name for services.
2025-05-28 16:57:45 -06:00
Yury Kossakovsky
3139ca54de Refactor logging messages in scripts for clarity
- Removed redundant log message in 04_wizard.sh related to COMPOSE_PROFILES.
- Updated success messages in apply_update.sh for improved readability and conciseness.
2025-05-28 16:45:52 -06:00
Yury Kossakovsky
d319f80133 Merge branch 'main' into develop 2025-05-28 16:40:05 -06:00
Yury Kossakovsky
36a1b7ac1b Add contributors section to README.md
- Introduced a new section in README.md to acknowledge project contributors.
- Added a link to the GitHub Contributors Page for easy access to contributor information.
2025-05-28 16:37:12 -06:00
Yury Kossakovsky
3fe6f5bf34 Merge pull request #1 from samfili/dev
Add new n8n grafana dashboard & fix  dashboard datasource  for provisioning on new grafana version
2025-05-28 16:30:06 -06:00
Yury Kossakovsky
c10e8df0a3 Update environment configuration and enhance logging in scripts
- Added COMPOSE_PROFILES variable to .env.example for better service profile management.
- Enhanced logging in 04_wizard.sh to provide clearer information on the read COMPOSE_PROFILES value.
- Updated apply_update.sh to improve success messages and removed redundant service stopping logic for clarity.
2025-05-27 20:49:41 -06:00
Yury Kossakovsky
6797dbb5c3 Enhance Weaviate configuration in docker-compose and secret generation script
- Added Weaviate username and password hash environment variables to docker-compose.yml for improved security and configuration.
- Updated 03_generate_secrets.sh to better handle existing environment variables and ensure proper initialization of the .env file.
2025-05-27 16:25:47 -06:00
Yury Kossakovsky
9ba99a33b4 Update Neo4j username handling in configuration files
- Set default Neo4j username in .env.example for easier configuration.
- Removed dynamic assignment of Neo4j username in 03_generate_secrets.sh to streamline secret generation.
- Updated user input variable list to reflect the changes in Neo4j username handling.
2025-05-27 15:58:07 -06:00
Yury Kossakovsky
ec4b0412a2 Add documentation for pre-installed libraries in n8n's Custom JavaScript
- Introduced a new section in README.md detailing the pre-installed Node.js libraries available for use in n8n's Code nodes, including `cheerio`, `axios`, `moment`, and `lodash`.
- Enhanced user understanding of available tools for web scraping, API requests, date manipulation, and utility functions.
2025-05-27 14:59:27 -06:00
Yury Kossakovsky
fa9c52af3e Update configuration files to enhance Weaviate and Neo4j integration
- Added Weaviate username, password, and API key placeholders to .env.example.
- Updated Caddyfile to include Prometheus reverse proxy settings.
- Enhanced docker-compose.yml with health checks and ulimits for Neo4j service.
- Modified scripts to include Neo4j in the service selection and final report outputs.
2025-05-27 14:45:07 -06:00
Yury Kossakovsky
50e6725b2e Add Neo4j service configuration and update related files
- Introduced Neo4j service in docker-compose.yml with necessary environment variables and volume mappings.
- Updated Caddyfile to include reverse proxy settings for Neo4j.
- Enhanced .env.example to include placeholders for Neo4j username and password.
- Modified README.md to document Neo4j integration and access details.
- Added .cursorignore file to specify files and directories to ignore during indexing.
2025-05-27 14:23:01 -06:00
Ivan Kurbanov
c8820f43e1 Add new n8n grafana dashboard & fix dashboard datasource for provisioning 2025-05-27 17:52:08 +03:00
Cole Medin
bfcb95af45 Added Neo4j (Knowledge Graph Engine) to the Local AI Package 2025-05-26 13:04:41 -05:00
Yury Kossakovsky
3c9a39d446 Enhance domain input handling in 03_generate_secrets.sh and update apply_update.sh
- Introduced logic to infer the current domain from N8N_HOSTNAME or SUPABASE_HOSTNAME for user prompts in 03_generate_secrets.sh.
- Improved user prompts to display the current domain as a default suggestion, enhancing user experience.
- Updated apply_update.sh to ensure the .env file is checked and updated by calling 03_generate_secrets.sh during the update process.
2025-05-24 10:15:04 -06:00
Yury Kossakovsky
c343d2c1e9 Add Weaviate service configuration and update documentation
- Introduced Weaviate service in docker-compose.yml with necessary environment variables and health checks.
- Updated Caddyfile to include reverse proxy settings for Weaviate with basic authentication.
- Enhanced README.md to document Weaviate's integration and access details.
- Modified scripts to generate secrets for Weaviate, including username and password handling.
- Updated final report script to display Weaviate configuration details for user clarity.
2025-05-24 09:41:14 -06:00
Yury Kossakovsky
ab7997a4ca Remove redundant log messages in scripts for improved clarity
- Eliminated unnecessary log_info statements in 03_generate_secrets.sh, 06_final_report.sh, and apply_update.sh to streamline output and enhance readability.
- Adjusted echo statements in 06_final_report.sh to maintain focus on essential information without clutter.
2025-05-23 17:37:27 -06:00
Yury Kossakovsky
eeb19f590f Refactor logging and user prompts in installation and wizard scripts
- Enhanced user feedback by replacing echo statements with log_info and log_error for better consistency in logging.
- Added empty echo statements before user prompts in 03_generate_secrets.sh to improve readability.
- Removed unnecessary log messages related to Caddy installation and uninstallation in 03_generate_secrets.sh.
- Updated 04_wizard.sh to include utility sourcing and improved logging for service selection and profile updates.
- Streamlined apply_update.sh by removing redundant log messages regarding Supabase compose file checks.
2025-05-23 15:05:23 -06:00
Yury Kossakovsky
b0a72d339d Update .env.example to include LETTA_SERVER_PASSWORD placeholder and add section separator
- Added a placeholder for LETTA_SERVER_PASSWORD to the .env.example file for clarity in configuration.
- Included a section separator for better organization of environment variables.
2025-05-22 18:05:38 -06:00
Yury Kossakovsky
3fd4cc9c23 Update Qdrant service configuration in docker-compose.yml and final_report.sh
- Removed comments for gRPC and HTTP REST API ports in docker-compose.yml to simplify the configuration.
- Corrected the internal REST API access message in final_report.sh to reflect the updated port usage, ensuring clarity in service access instructions.
2025-05-22 17:52:51 -06:00
Yury Kossakovsky
a9a6493e5f Add gRPC and HTTP REST API ports to Qdrant service in docker-compose.yml
- Exposed ports 6333 and 6334 for gRPC and HTTP REST API access, respectively, enhancing service connectivity and functionality.
2025-05-22 17:47:42 -06:00
Yury Kossakovsky
1db81b35da Update Supabase reporting in final_report.sh to enhance clarity
- Removed detailed PostgreSQL connection information to streamline output.
- Added Service Role Secret to provide necessary context for Supabase configuration.
- Improved overall readability of the Supabase section in the final report.
2025-05-22 17:38:37 -06:00
Yury Kossakovsky
abaeea95e8 Temporarily remove comment on cap_drop in docker-compose.yml for SearXNG service
- Updated the comment for the cap_drop directive to clarify its temporary status for initial testing, ensuring users are aware of the context without referencing external documentation.
2025-05-22 14:27:44 -06:00
Yury Kossakovsky
6cd3eb7927 Refactor apply_update.sh to streamline service update process
- Removed redundant service selection wizard invocation from the pull section, ensuring it runs first to update service choices.
- Enhanced logging messages for clarity regarding the Supabase compose file inclusion and Docker image pulling.
- Improved error handling for the service selection wizard failure, preventing continuation of the update process if it fails.
2025-05-22 14:19:28 -06:00
Yury Kossakovsky
5eae1e4872 Remove container removal command from apply_update.sh for 'localai' project to streamline shutdown process and improve error handling. 2025-05-22 14:11:08 -06:00
Yury Kossakovsky
f5aa8a5ddf Refactor service management in start_services.py and scripts
- Updated the is_supabase_enabled function to read COMPOSE_PROFILES from the .env file instead of os.environ, improving clarity.
- Simplified the run_command function by removing the unused env parameter.
- Refined the stop_existing_containers function to streamline the shutdown process for the 'localai' project, conditionally including the Supabase compose file.
- Enhanced logging for better user feedback during service management operations.
- Adjusted the scripts for generating secrets and applying updates to improve clarity and functionality.
2025-05-22 14:09:28 -06:00
Yury Kossakovsky
1c2b348ee3 Add .env.bak to .gitignore
- Included .env.bak in the .gitignore file to prevent backup environment files from being tracked by Git, ensuring a cleaner repository and reducing the risk of accidentally committing sensitive information.
2025-05-22 13:46:54 -06:00
Yury Kossakovsky
5351443f76 Refactor Supabase compose file handling in start_services.py
- Updated the stop_existing_containers function to conditionally include the Supabase compose file only if Supabase is enabled, improving clarity and functionality.
- Added logging to inform users about the presence or absence of the Supabase compose file, enhancing the shutdown process.
- Included checks for the existence of the Supabase compose file to provide context when Supabase is disabled, ensuring better user feedback.
2025-05-22 13:46:02 -06:00
Yury Kossakovsky
f11b303531 Temporarily comment out cap_drop in docker-compose.yml for SearXNG service
- Commented out the cap_drop directive to allow for initial testing without dropping all capabilities, as noted in the accompanying documentation.
- Retained the entrypoint script for managing directory permissions and starting the SearXNG application, ensuring functionality remains intact during this change.
2025-05-22 13:37:08 -06:00
Yury Kossakovsky
767195b7ce Add entrypoint script to docker-compose.yml for SearXNG service
- Introduced an entrypoint script to handle directory permissions for the SearXNG service, ensuring proper ownership and access rights.
- The script includes commands to change ownership and permissions of the /etc/searxng directory before starting the SearXNG application, enhancing security and functionality during container startup.
2025-05-22 13:33:56 -06:00
Yury Kossakovsky
0c24dd07f8 Add force stop functionality for lingering containers in start_services.py
- Introduced a new function, force_stop_lingering_containers, to identify and force stop containers that may be running outside of the current Docker Compose management.
- Implemented logic to check for specific container patterns and handle stopping and removing them, enhancing the shutdown process.
- Improved error handling to manage potential issues during the force stop operation, ensuring robustness in service management.
2025-05-22 13:24:46 -06:00
Yury Kossakovsky
16e8b9a059 Refactor environment handling in stop_existing_containers function in start_services.py
- Updated the stop_existing_containers function to explicitly remove the COMPOSE_PROFILES environment variable when stopping and removing containers, ensuring all services are affected.
- Improved clarity by modifying the environment passed to run_command for both stop and remove operations, enhancing the shutdown process consistency.
2025-05-22 13:20:57 -06:00
Yury Kossakovsky
6505208f9c Refactor container shutdown process in start_services.py to improve clarity and functionality
- Updated the stop_existing_containers function to explicitly stop and remove all existing containers for the 'localai' project.
- Enhanced logging to provide clearer messages regarding the presence of the Supabase compose file during the shutdown process.
- Separated the stop and remove commands for better readability and maintainability of the shutdown logic.
2025-05-22 13:19:02 -06:00
Yury Kossakovsky
4750e92a65 Enhance run_command function in start_services.py to accept environment variables
- Modified the run_command function to include an optional env parameter, allowing explicit environment variable management during subprocess execution.
- Updated calls to run_command throughout the script to pass os.environ.copy(), ensuring the correct COMPOSE_PROFILES are used for service operations.
- Removed outdated comments regarding COMPOSE_PROFILES manipulation, reflecting the current environment handling approach.
2025-05-22 11:55:58 -06:00
Yury Kossakovsky
40c63a1d93 Refactor shutdown process in start_services.py to always include Supabase compose file
- Updated the 'down' command to always include the Supabase compose file if it exists, ensuring proper shutdown of services.
- Removed the temporary clearing of COMPOSE_PROFILES, as the current environment is now managed by load_dotenv().
- Enhanced logging to inform users about the presence or absence of the Supabase compose file during shutdown.
2025-05-22 11:52:08 -06:00
Yury Kossakovsky
a729baa3c9 Improve container shutdown process in start_services.py
- Enhanced the 'down' command to conditionally include the Supabase compose file based on the current environment settings.
- Implemented temporary clearing of COMPOSE_PROFILES to ensure all services are affected during shutdown.
- Added error handling to restore the original COMPOSE_PROFILES after command execution, maintaining environment integrity.
2025-05-22 11:43:18 -06:00
Yury Kossakovsky
a461b783b9 Enhance environment variable handling in start_services.py
- Added load_dotenv() to load environment variables from the .env file, ensuring that COMPOSE_PROFILES is retrieved from the environment.
- Updated the is_supabase_enabled() function to check for 'supabase' in the environment variable instead of directly from the .env file.
- Improved the documentation to clarify the reliance on environment variables for service configuration.
2025-05-22 11:39:11 -06:00
Yury Kossakovsky
394e4669eb Refactor installation summary logging in final report generation
- Moved the installation summary logging from 06_final_report.sh to install.sh to ensure it is displayed immediately after the installation steps.
- Improved the organization of the final report generation process by consolidating related logging functionality.
- Enhanced user visibility of installation steps performed during the setup process.
2025-05-22 11:34:45 -06:00
Yury Kossakovsky
8c017549f2 Add final report display in apply_update.sh to show service credentials
- Implemented a final report display feature in apply_update.sh to show service credentials post-update.
- Added error handling to log a warning if the final report fails to display, ensuring the update process remains unaffected.
- Enhanced user experience by providing a summary of service credentials after a successful update.
2025-05-22 11:29:09 -06:00
Yury Kossakovsky
2baafa495b Refactor service selection in wizard script and integrate into update process
- Updated the service selection logic in 04_wizard.sh to dynamically populate available services based on current COMPOSE_PROFILES from the .env file.
- Enhanced the Ollama hardware profile selection to reflect user choices and defaults based on existing profiles.
- Integrated the service selection wizard into apply_update.sh to streamline the update process and ensure user-defined service configurations are applied.
- Improved user prompts and handling for service choices, enhancing overall configuration experience.
2025-05-22 11:27:45 -06:00
Yury Kossakovsky
ae5cd1aab2 Enhance n8n import handling in apply_update.sh and update secrets generation
- Added logic to determine the N8N_WORKFLOWS_IMPORTED_EVER variable based on existing environment values and user input.
- Updated the apply_update.sh script to check if workflows have been imported previously, modifying the RUN_N8N_IMPORT and N8N_WORKFLOWS_IMPORTED_EVER variables accordingly.
- Improved user prompts for importing n8n workflows, ensuring a smoother configuration experience.
2025-05-22 11:22:11 -06:00
Yury Kossakovsky
be6a52303f Add new n8n workflow for AI-powered video generation and multi-platform publishing
- Introduced a comprehensive workflow that automates the generation of short-form videos using OpenAI, Flux, Kling, and ElevenLabs.
- The workflow includes nodes for image generation, video creation, voiceover generation, and uploading to multiple social media platforms.
- Enhanced user guidance with sticky notes detailing setup instructions and API key requirements for seamless integration.
- Implemented error handling and retry mechanisms to ensure robust execution of video generation tasks.
2025-05-19 17:42:58 -06:00
Yury Kossakovsky
5d1e46430c Add PostgreSQL configuration for n8n and Langfuse in final report script
- Enhanced the final report script to include details for a standalone PostgreSQL instance used by n8n and Langfuse.
- Added Ollama service information for internal access based on active profiles.
- Clarified the distinction between Supabase's internal PostgreSQL and the standalone instance for better user understanding.
2025-05-15 20:48:32 -06:00
Yury Kossakovsky
d2abd6e036 Add Ollama service configuration to docker-compose.yml and update related files
- Introduced Ollama service with CPU and GPU profiles in docker-compose.yml, allowing users to run large language models locally.
- Added Ollama selection option in the wizard script for hardware profile configuration.
- Updated README.md to include Ollama as a new available service.
- Adjusted .env.example to include GRAFANA_HOSTNAME in the correct position.
2025-05-15 20:44:36 -06:00