New release: 0.3.2 for Rhea: Latent Loom – self hosted LLM service

descriptionStandard

This update 0.3.2 introduces support for Text formats/Response formats support PyDantic JSON model schemas:

  • Refinements to endpoint: /v1/responses
    • Adds parameters for test_format (Response formats) supporting PyDantic model JSON schemas.
    • Adds response parameter: output_parsed.
  • Refinements to default parameters on endpoint: /v1/chat/completions
  • Additional schema models.

Table of Contents

Please note that no active endpoints are provided; if you would like to test this further with a active/real deployment please get in touch with us.

The Swagger UI Bundle is configured to enable the server endpoint url to be defined as a URI parameter: `<host>/?server=https://oddineers.co.uk` .

View the documentation here: Rhea: Latent Loom API Explorer – GitLab Pages or read about use case at: Unweaving the cloud: Local LLMs and Private RAG with Rhea: Latent Loom.

Learn more about the Rhea Generative Framework.

Leave a Reply

Your email address will not be published. Required fields are marked *