Midori AI Subsystem Manager V2

Midori AI photo Midori AI photo

The Midori AI Subsystem offers an innovative solution for managing AI workloads through its advanced integration with containerization technologies. Leveraging the lightweight and efficient design of PixelArch OS, this system empowers developers, researchers, and hobbyists test AI systems effortlessly across a variety of environments.

At the heart of the Midori AI Subsystem is PixelArch OS, a custom Arch Linux-based operating system optimized for containerized workloads. It provides a lightweight, streamlined environment tailored for modern AI development.

  • Simplified Deployment: Deploy AI systems effortlessly with pre-configured or built-on-request container images tailored to your needs.
  • Platform Versatility: Supports Docker, Podman, LXC, and other systems, allowing you to choose the best fit for your infrastructure.
  • Seamless Experimentation: Experiment with various AI tools and models in isolated environments without worrying about conflicts or resource constraints.
  • Effortless Scalability: Scale AI workloads efficiently by leveraging containerization technologies.
  • Standardized Configurations: Reduce guesswork with standardized setups for AI programs.
  • Unleash Creativity: Focus on innovating and developing AI solutions while the Subsystem handles system configuration and compatibility.
Notice

Warnings / Heads up

  • This program is in beta! By using it you take on risk, please see the disclaimer in the footnotes

Known Issues

  • Server Rework is underway! Thank you for giving us lots of room to grow!
  • Report Issuses -> Github Issue

Install Midori AI Subsystem Manager

​

Prerequisites

Quick install with script

Copy and paste this into a SH or Batch file then run it.

git clone https://github.com/lunamidori5/Midori-AI-Subsystem-Manager.git
cd Midori-AI-Subsystem-Manager/
cd subsystem-manager-2-uv/
uv run main.py

Running the program

Open a terminal and run:

uv run main.py

Running the program as root

Open a terminal and run:

sudo uv run main.py

Coming soon! Please use UV for now.

Click here to go to the old install page

Auto Lint, Test, and Build. Auto Lint, Test, and Build.

Notice

Reminder to always use your computers IP address not localhost when using the Midori AI Subsystem!

Support and Assistance

If you encounter any issues or require further assistance, please feel free to reach out through the following channels:

—– Disclaimer —–

The functionality of this product is subject to a variety of factors that are beyond our control, and we cannot guarantee that it will work flawlessly in all situations. We have taken every possible measure to ensure that the product functions as intended, but there may be instances where it does not perform as expected. Please be aware that we cannot be held responsible for any issues that arise due to the product’s functionality not meeting your expectations. By using this product, you acknowledge and accept the inherent risks associated with its use, and you agree to hold us harmless for any damages or losses that may result from its functionality not being guaranteed.

—– Footnotes —–

*For your safety we have posted the code of this program onto github, please check it out! - Github

**If you would like to give to help us get better servers - Give Support

***If you or someone you know would like a new backend supported by Midori AI Subsystem please reach out to us at [email protected]

Subsections of Midori AI Subsystem Manager V2

Midori AI Subsystem Manager V1 (SUNSET)

Midori AI photo Midori AI photo

How Docker Works

Docker is a containerization platform that allows you to package and run applications in isolated and portable environments called containers. Containers share the host operating system kernel but have their own dedicated file system, processes, and resources. This isolation allows applications to run independently of the host environment and each other, ensuring consistent and predictable behavior.

Midori AI Subsystem - Github Link

The Midori AI Subsystem extends Docker’s capabilities by providing a modular and extensible platform for managing AI workloads. Each AI system is encapsulated within its own dedicated Docker image, which contains the necessary software and dependencies. This approach provides several benefits:

  • Simplified Deployment: The Midori AI Subsystem provides a streamlined and efficient way to deploy AI systems using Docker container technology.
  • Eliminates Guesswork: Standardized configurations and settings reduce complexities, enabling seamless setup and management of AI programs.
Notice

Warnings / Heads up

  • This program is in beta! By using it you take on risk, please see the disclaimer in the footnotes
  • The Webserver should be back up, sorry for the outage

Known Issues

  • Server Rework is underway! Thank you for giving us lots of room to grow!
  • Report Issuses -> Github Issue

Windows Users

Install Midori AI Subsystem Manager

Notice
  • As we are in beta, we have implemented telemetry to enhance bug discovery and resolution. This data is anonymized and will be configurable when out of beta.
​

Recommened Prerequisites

Should you be missing this prerequisite, the manager is capable of installing it on your behalf. Docker Desktop Windows

Please make a folder for the Manager program with nothing in it, do not use the user folder.

Quick install

  1. Download - https://tea-cup.midori-ai.xyz/download/model_installer_windows.zip
  2. Unzip into the folder you made
  3. Run subsystem_manager.exe

Quick install with script

Open a Command Prompt or PowerShell terminal and run:

curl -sSL https://raw.githubusercontent.com/lunamidori5/Midori-AI-Subsystem-Manager/master/model_installer/shell_files/model_installer.bat -o subsystem_manager.bat && subsystem_manager.bat

Manual download and installation

Open a Command Prompt or PowerShell terminal and run:

curl -sSL https://tea-cup.midori-ai.xyz/download/model_installer_windows.zip -o subsystem_manager.zip
powershell Expand-Archive subsystem_manager.zip -DestinationPath .
subsystem_manager.exe

Recommened Prerequisites

If these prerequisites are missing, the manager can install them for you on Debian or Arch-based distros. Docker Engine and Docker Compose

or

Docker Desktop Linux

Quick install with script

curl -sSL https://raw.githubusercontent.com/lunamidori5/Midori-AI-Subsystem-Manager/master/model_installer/shell_files/model_installer.sh > model_installer.sh && bash ./model_installer.sh

Manual download and installation

Open a terminal and run:

curl -sSL https://tea-cup.midori-ai.xyz/download/model_installer_linux.tar.gz -o subsystem_manager.tar.gz
tar -xzf subsystem_manager.tar.gz
chmod +x subsystem_manager
sudo ./subsystem_manager

Warning

Unraid is not fully supported by the Subsystem Manager, We are working hard to fix this, if you have issues please let us know on the github.

Prerequisites

Download and set up Docker Compose Plugin

Manual download and installation

Click on the settings gear icon, then click the compose file menu item

After that copy and paste this into the Docker Compose Manager plugin You may need to edit the mounts to the left of the :

CPU Only:

services:
  midori_ai_unraid:
    image: lunamidori5/subsystem_manager:master
    ports:
    - 39090:9090
    privileged: true
    restart: always
    tty: true
    volumes:
    - /mnt/user/appdata/MidoriAI/system:/var/lib/docker/volumes/midoriai_midori-ai/_data
    - /mnt/user/appdata/MidoriAI/models:/var/lib/docker/volumes/midoriai_midori-ai-models/_data
    - /mnt/user/appdata/MidoriAI/images:/var/lib/docker/volumes/midoriai_midori-ai-images/_data
    - /mnt/user/appdata/MidoriAI/audio:/var/lib/docker/volumes/midoriai_midori-ai-audio/_data
    - /var/run/docker.sock:/var/run/docker.sock

CPU and Nvidia GPU:

services:
  midori_ai_unraid:
    deploy:
      resources:
         reservations:
            devices:
            - driver: nvidia
              count: 1
              capabilities: [gpu] 
    image: lunamidori5/subsystem_manager:master
    ports:
    - 39090:9090
    privileged: true
    restart: always
    tty: true
    volumes:
    - /mnt/user/appdata/MidoriAI/system:/var/lib/docker/volumes/midoriai_midori-ai/_data
    - /mnt/user/appdata/MidoriAI/models:/var/lib/docker/volumes/midoriai_midori-ai-models/_data
    - /mnt/user/appdata/MidoriAI/images:/var/lib/docker/volumes/midoriai_midori-ai-images/_data
    - /mnt/user/appdata/MidoriAI/audio:/var/lib/docker/volumes/midoriai_midori-ai-audio/_data
    - /var/run/docker.sock:/var/run/docker.sock

Running the program

Start up that docker then run the following in it by clicking console

python3 subsystem_python_runner.py

Prerequisites

Do not use on windows

Please make a folder for the Manager program with nothing in it, do not use the user folder.

Quick install with script

Download this file

curl -sSL https://raw.githubusercontent.com/lunamidori5/Midori-AI-Subsystem-Manager/master/midori_ai_manager/subsystem_python_runner.py > subsystem_python_runner.py

Running the program

Open a terminal and run:

python3 subsystem_python_runner.py

Running the program as root (Linux Only)

Open a terminal and run:

sudo python3 subsystem_python_runner.py

Auto Lint, Test, and Build. Auto Lint, Test, and Build.

Notice

Reminder to always use your computers IP address not localhost when using the Midori AI Subsystem!

Support and Assistance

If you encounter any issues or require further assistance, please feel free to reach out through the following channels:

—– Disclaimer —–

The functionality of this product is subject to a variety of factors that are beyond our control, and we cannot guarantee that it will work flawlessly in all situations. We have taken every possible measure to ensure that the product functions as intended, but there may be instances where it does not perform as expected. Please be aware that we cannot be held responsible for any issues that arise due to the product’s functionality not meeting your expectations. By using this product, you acknowledge and accept the inherent risks associated with its use, and you agree to hold us harmless for any damages or losses that may result from its functionality not being guaranteed.

—– Footnotes —–

*For your safety we have posted the code of this program onto github, please check it out! - Github

**If you would like to give to help us get better servers - Give Support

***If you or someone you know would like a new backend supported by Midori AI Subsystem please reach out to us at [email protected]