Llava Captioner (v1.1)

About this version

About this app (See raw metadata.json)

Applies llava to video frames.

Inputs

(Note: “*” as a property value means that the property is required but can be any value.)

Configurable Parameters

(Note: Multivalued means the parameter can have one or more values.)

  • defaultPrompt: optional, defaults to What is shown in this video frame?

    • Type: string
    • Multivalued: False

    default prompt to use for timeframes not specified in the promptMap. If set to -, timeframes not specified in the promptMap will be skipped.

  • promptMap: optional, defaults to []

    • Type: map
    • Multivalued: True

    mapping of labels of the input timeframe annotations to new prompts. Must be formatted as “IN_LABEL:PROMPT” (with a colon). To pass multiple mappings, use this parameter multiple times. By default, any timeframe labels not mapped to a prompt will be used with the defaultprompt. In order to skip timeframes with a particular label, pass - as the prompt value.in order to skip all timeframes not specified in the promptMap, set the defaultPromptparameter to -

  • pretty: optional, defaults to false

    • Type: boolean
    • Multivalued: False
    • Choices: false, true

    The JSON body of the HTTP response will be re-formatted with 2-space indentation

Outputs

(Note: “*” as a property value means that the property is required but can be any value.)

(Note: Not all output annotations are always generated.)