Prismatic VLM REPL - Revision history

Vrtnis at 00:51, 21 June 2024

2024-06-21T00:51:58Z

2024-06-21T00:44:27Z

2024-06-21T00:42:41Z

2024-06-21T00:40:33Z

2024-06-21T00:40:07Z

2024-06-21T00:36:30Z

2024-06-21T00:34:31Z

2024-06-21T00:32:28Z

‎REPL Script Guide

2024-06-21T00:32:08Z

2024-06-21T00:31:16Z

@@ Line 5: / Line 5: @@
 == Prismatic REPL Script Guide ==
-Here are some suggestions to run the generate.py REPL Script from the repo (you can find this in the '''scripts''' folder) if you would like to get started.
+Here are some suggestions to run the generate.py REPL Script from the repo (you can find this in the '''scripts''' folder).
 == Prerequisites ==

← Older revision		Revision as of 00:44, 21 June 2024
Line 1:		Line 1:
−	Prismatic VLM is the project upon which OpenVLA is based. The generate.py REPL script is available in the OpenVLA repo as well but is essentially using Prismatic models. Note that the Prismatic models generate natural language whereas OpenVLA models were trained to generate robot actions. (see this https://github.com/openvla/openvla/issues/5).	+	[https://github.com/TRI-ML/prismatic-vlms Prismatic VLM] is the project upon which OpenVLA is based. The generate.py REPL script is available in the OpenVLA repo as well but is essentially using Prismatic models. Note that the Prismatic models generate natural language whereas OpenVLA models were trained to generate robot actions. (see this https://github.com/openvla/openvla/issues/5).

	Of note, the K-Scale OpenVLA adaptation by [[User:Paweł]] is at https://github.com/kscalelabs/openvla		Of note, the K-Scale OpenVLA adaptation by [[User:Paweł]] is at https://github.com/kscalelabs/openvla

← Older revision		Revision as of 00:42, 21 June 2024
Line 1:		Line 1:
−	Prismatic VLM is the project upon which OpenVLA is based. The generate script is available in the OpenVLA repo as well but is essentially using Prismatic. Note that the Prismatic models generate natural language whereas OpenVLA models were trained to generate robot actions. (see this https://github.com/openvla/openvla/issues/5).	+	Prismatic VLM is the project upon which OpenVLA is based. The generate.py REPL script is available in the OpenVLA repo as well but is essentially using Prismatic models. Note that the Prismatic models generate natural language whereas OpenVLA models were trained to generate robot actions. (see this https://github.com/openvla/openvla/issues/5).

	Of note, the K-Scale OpenVLA adaptation by [[User:Paweł]] is at https://github.com/kscalelabs/openvla		Of note, the K-Scale OpenVLA adaptation by [[User:Paweł]] is at https://github.com/kscalelabs/openvla

@@ Line 55: / Line 55: @@
 You should see this in your terminal:
-[[File:Openvla1.png|800px|openvla models]]
+[[File:Openvla1.png|800px|prismatic models]]
@@ Line 66: / Line 66: @@
 (p) to update the prompt template for generating outputs,
 (q) to quit the REPL, or directly input a prompt to generate a response based on the loaded image and the specified prompt.
-[[File:Prismatic chat1.png|800px|openvla models]]
+[[File:Prismatic chat1.png|800px|prismatic chat]]

@@ Line 66: / Line 66: @@
 (p) to update the prompt template for generating outputs,
 (q) to quit the REPL, or directly input a prompt to generate a response based on the loaded image and the specified prompt.
+[[File:Prismatic chat1.png|800px|openvla models]]

← Older revision		Revision as of 00:36, 21 June 2024
Line 1:		Line 1:
−	Prismatic VLM is the project upon which OpenVLA is based. The generate script is available in the OpenVLA repo as well but is essentially using Prismatic (see this https://github.com/openvla/openvla/issues/5). ~~The~~ K-Scale OpenVLA adaptation by [[User:Paweł]] is at https://github.com/kscalelabs/openvla	+	Prismatic VLM is the project upon which OpenVLA is based. The generate script is available in the OpenVLA repo as well but is essentially using Prismatic. Note that the Prismatic models generate natural language whereas OpenVLA models were trained to generate robot actions. (see this https://github.com/openvla/openvla/issues/5).
		+
		+	Of note, the K-Scale OpenVLA adaptation by [[User:Paweł]] is at https://github.com/kscalelabs/openvla

	== Prismatic REPL Script Guide ==		== Prismatic REPL Script Guide ==

@@ Line 1: / Line 1: @@
-Prismatic VLM is the project upon which OpenVLA is based. The K-Scale OpenVLA adaptation by [[User:Paweł]]  is at https://github.com/kscalelabs/openvla
+Prismatic VLM is the project upon which OpenVLA is based. The generate script is available in the OpenVLA repo as well but is essentially using Prismatic (see this https://github.com/openvla/openvla/issues/5). The K-Scale OpenVLA adaptation by [[User:Paweł]]  is at https://github.com/kscalelabs/openvla
-== REPL Script Guide ==
+== Prismatic REPL Script Guide ==
 Here are some suggestions to run the generate.py REPL Script from the repo (you can find this in the '''scripts''' folder) if you would like to get started.

← Older revision		Revision as of 00:32, 21 June 2024
Line 1:		Line 1:
−	The K-Scale OpenVLA adaptation by [[User:Paweł]] is at https://github.com/kscalelabs/openvla	+	Prismatic VLM is the project upon which OpenVLA is based. The K-Scale OpenVLA adaptation by [[User:Paweł]] is at https://github.com/kscalelabs/openvla

	== REPL Script Guide ==		== REPL Script Guide ==

← Older revision	Revision as of 00:31, 21 June 2024
(No difference)