Skip to content

v1.16: Experimental: Multimodal search #3298

@guimachiavelli

Description

@guimachiavelli

v1.16 introduces a new experimental feature, multimodal. When activated, it enables two new embedder settings, indexingFragments and searchFragments, and one new search parameter, media. Used together, they make it possible to generate embeddings based on image instead of text. They also allow users to perform searches based on base64 images, image URLs, or text.

Tasks

  • Update experimental feature overview table
  • Update error codes reference
  • Update Settings reference > Embedders with indexingFragments and searchFragments
  • Update Search reference with media

References

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions