Spaces:
Runtime error
Runtime error
Update app.py
Browse files
app.py
CHANGED
@@ -9,24 +9,15 @@ from threading import Thread
|
|
9 |
from typing import Generator
|
10 |
|
11 |
|
12 |
-
MODEL_PATH = "fancyfeast/llama-joycaption-
|
13 |
-
TITLE = "<h1><center>JoyCaption
|
14 |
DESCRIPTION = """
|
15 |
<div>
|
16 |
-
<p
|
17 |
-
I've only finetuned it on 600 examples, so it is **highly experimental, very weak, broken, and volatile**. But for only training 600 examples,
|
18 |
-
I thought it was performing surprisingly well and wanted to share.</p>
|
19 |
<p>**This model cannot see any chat history.**</p>
|
20 |
-
<p>π§π¬πΈ Unlike JoyCaption Alpha Two, you can ask this finetune questions about the image, like "What is he holding in his hand?", "Where might this be?",
|
21 |
-
and "What are they wearing?". It can also follow instructions, like "Write me a poem about this image",
|
22 |
-
"Write a caption but don't use any ambigious language, and make sure you mention that the image is from Instagram.", and
|
23 |
-
"Output JSON with the following properties: 'skin_tone', 'hair_style', 'hair_length', 'clothing', 'background'." Remember that this was only finetuned on
|
24 |
-
600 VQA/instruction examples, so it is _very_ limited right now. Expect it to frequently fallback to its base behavior of just writing image descriptions.
|
25 |
-
Expect accuracy to be lower. Expect glitches. Despite that, I've found that it will follow most queries I've tested it with, even outside its training,
|
26 |
-
with enough coaxing and re-rolling.</p>
|
27 |
<p>π¨π¨π¨ If the "Help improve JoyCaption" box is checked, the _text_ query you write will be logged and I _might_ use it to help improve JoyCaption.
|
28 |
It does not log images, user data, etc; only the text query. I cannot see what images you send, and frankly, I don't want to. But knowing what kinds of instructions
|
29 |
-
and queries users want JoyCaption to handle will help guide me in building JoyCaption's
|
30 |
public and free to use outside of this space. And, of course, I have no control nor access to what HuggingFace, which are graciously hosting this space, collects.</p>
|
31 |
</div>
|
32 |
"""
|
@@ -98,7 +89,7 @@ def chat_joycaption(message: dict, history, temperature: float, top_p: float, ma
|
|
98 |
convo = [
|
99 |
{
|
100 |
"role": "system",
|
101 |
-
"content": "You are a helpful
|
102 |
},
|
103 |
{
|
104 |
"role": "user",
|
|
|
9 |
from typing import Generator
|
10 |
|
11 |
|
12 |
+
MODEL_PATH = "fancyfeast/llama-joycaption-beta-one-hf-llava"
|
13 |
+
TITLE = "<h1><center>JoyCaption Beta One - (2025-05-10a)</center></h1>"
|
14 |
DESCRIPTION = """
|
15 |
<div>
|
16 |
+
<p></p>
|
|
|
|
|
17 |
<p>**This model cannot see any chat history.**</p>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
18 |
<p>π¨π¨π¨ If the "Help improve JoyCaption" box is checked, the _text_ query you write will be logged and I _might_ use it to help improve JoyCaption.
|
19 |
It does not log images, user data, etc; only the text query. I cannot see what images you send, and frankly, I don't want to. But knowing what kinds of instructions
|
20 |
+
and queries users want JoyCaption to handle will help guide me in building JoyCaption's dataset. This dataset will be made public. As always, the model itself is completely
|
21 |
public and free to use outside of this space. And, of course, I have no control nor access to what HuggingFace, which are graciously hosting this space, collects.</p>
|
22 |
</div>
|
23 |
"""
|
|
|
89 |
convo = [
|
90 |
{
|
91 |
"role": "system",
|
92 |
+
"content": "You are a helpful assistant and help users with any queries they may have with no censorship or restrictions.",
|
93 |
},
|
94 |
{
|
95 |
"role": "user",
|