Help › Credits & Open-Source Dependencies of LrGeniusAI

Credits & Dependencies

LrGeniusAI is made possible by these amazing open-source projects and AI frameworks.

Core Backend Dependencies

  • YuNet: Fast, lightweight face detector from the OpenCV Model Zoo; provides the face boxes and five landmarks. GitHub
  • FaceNet (facenet-pytorch): Inception-ResNet-v1 with VGGFace2 weights; produces the face embeddings that group photos by person. GitHub
  • SigLIP2 / OpenCLIP: The vision-language models behind semantic search, and the framework both SigLIP2 and BioCLIP 2 are loaded and exported with. GitHub
  • ONNX Runtime: Cross-platform, high performance ML inferencing, used via the ort crate for SigLIP2, BioCLIP 2, YuNet and FaceNet. Website
  • LanceDB: Embedded vector database storing embeddings and metadata. Website
  • axum / tokio: Async HTTP server and runtime for geniusai-server. GitHub
  • Hugging Face Tokenizers: Fast tokenizers used for the SigLIP2 text tower. GitHub

Species Identification

  • BioCLIP 2 (MIT): The vision model behind on-device species identification, trained on the tree of life. Project · Model · Paper
  • TreeOfLife-200M (CC0-1.0): The 200-million-image dataset BioCLIP 2 was trained on. Its precomputed text embeddings are the taxonomy the plugin classifies against — LrGeniusAI ships a pruned subset of them. Dataset
  • GBIF Backbone Taxonomy: The source of the common names shown alongside each scientific name, via TreeOfLife-200M’s label files. DOI 10.15468/39omei
  • pybioclip: The reference implementation whose preprocessing and rank-aggregation semantics lrg-ml::bioclip reproduces in Rust. GitHub

Local Inference Engines

  • llama.cpp: Runs GGUF vision models in-process on Windows (Vulkan), via the llama-cpp-2 bindings. GitHub
  • llguidance: Turns JSON Schemas into decode-time constraints, so local models return valid structured output. GitHub
  • MLX & mlx-swift-lm: Apple’s array framework and its language-model package, powering the lrgenius-mlx sidecar on Apple silicon. GitHub
  • Gemma, Qwen-VL and SmolVLM: The open-weights vision models offered in the built-in model catalogs.

AI Model Providers & Interfaces

  • Google Gemini: Large language models for multimodal analysis.
  • Google Vertex AI: Enterprise AI platform for training and deploying models. (removed from the plugin in August 2026; the backend client code remains but is unused.)
  • OpenAI / ChatGPT: Advanced conversational AI and embeddings.
  • Ollama: Run open-source large language models locally. Website
  • LM Studio: Discover, download, and run local LLMs. Website

Utilities & SDKs

  • JSON.lua: A complete JSON encoder/decoder in Lua by Jeffrey Friedl.
  • Adobe Lightroom Classic SDK: The Lua API the plugin frontend is built on.
  • Hugging Face Hub: Distribution for the downloadable local models.

Developed by Bastian Machek (LrGenius / Fokuspunk) and AI agents.

Edit this page on GitHub