talk2nextcloud

Symfony web application to interact with Nextcloud using audio input, which is processed by Gemini LLM using custom Nextcloud tools.

Installation

apt install ffmpeg # or any other way to install ffmpeg and ffprobe - used to convert browser audio

composer install

npm clean-install && npm run build

Configuration

Add a .env.local file:

APP_ENV=prod
APP_SECRET=tbd
JWT_PASSPHRASE=tbd

NEXTCLOUD_URL=https://tbd.com
NEXTCLOUD_USER=tbd
NEXTCLOUD_PASSWORD=tbd

# Configure API keys for LLM providers (leave empty to disable a provider)
GEMINI_API_KEY=tbd
OPENAI_API_KEY=tbd

Generate JWT tokens using bin/console lexik:jwt:generate-keypair.

Currently available AI Agent tools

• Nextcloud Notes
  • nextcloud-list-notes
  • nextcloud-read-note
  • nextcloud-append-to-note

Build docker image

docker build -f ./docker/Dockerfile .

To run it, you need to mount a volume for the jwt keys in /srv/app/config/jwt and set the environment variables mentioned above.