feat: add distributed mode (experimental)

[mudler]

Description

The objective of this PR is to make LocalAI scalable horizontally, and delegate processing to remote gRPC LocalAI workers.

Notes for Reviewers

TODO:

• Make sure we sync to nodes also files that are mentioned inside options (this is a bit more challenging) and mmproj files
• re-use the vram detection logic to route models more efficiently to the nodes that have free vram, not only on capacity
• Add hints in the UI on how to start workers
• Backend management in distributed mode (should be able to install/delete backends as well)
• Model management (if a model is deleted from the frontend, should be removed from the nodes too)
• Dynamic auth tokens for nodes (Currently user have to specify a registration token manually in the frontend and in the workers have to be the same) -> went with approval/auto-approval mode

Signed commits

• Yes, I signed my commits.

[netlify]

❌ Deploy Preview for localai failed.

Name	Link
🔨 Latest commit	36bed92
🔍 Latest deploy log	https://app.netlify.com/projects/localai/deploys/69c2dad20257010008196f4d