Image-Text-to-Text
Transformers.js
ONNX
florence2
vision
text-generation
text2text-generation
image-to-text
Instructions to use onnx-community/Florence-2-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use onnx-community/Florence-2-base with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('image-text-to-text', 'onnx-community/Florence-2-base');
Update config.json
Browse files- config.json +1 -0
config.json
CHANGED
|
@@ -8,6 +8,7 @@
|
|
| 8 |
"ignore_index": -100,
|
| 9 |
"is_encoder_decoder": true,
|
| 10 |
"model_type": "florence2",
|
|
|
|
| 11 |
"pad_token_id": 1,
|
| 12 |
"projection_dim": 768,
|
| 13 |
"text_config": {
|
|
|
|
| 8 |
"ignore_index": -100,
|
| 9 |
"is_encoder_decoder": true,
|
| 10 |
"model_type": "florence2",
|
| 11 |
+
"num_image_tokens": 577,
|
| 12 |
"pad_token_id": 1,
|
| 13 |
"projection_dim": 768,
|
| 14 |
"text_config": {
|