Open main menu

Humanoid Robots Wiki β

Changes

Prismatic VLM REPL

466 bytes added, 20 June
no edit summary
''After loading the model, the script enters a REPL mode, allowing the user to interact with the model. The REPL mode provides a default generation setup and waits for user inputs.''
Basically, the generate.py script runs a REPL that allows users to interactively test generating outputs from the Prismatic model prism-dinosiglip+7b. Upon running the script, users can enter commands in the REPL prompt:
type (i) to load a new local image by specifying its path,
(p) to update the prompt template for generating outputs,
(q) to quit the REPL, or directly input a prompt to generate a response based on the loaded image and the specified prompt.
''work in progress,need to add screenshots and next steps''