candle_transformers/models/pixtral/
mod.rs

1//! Pixtral Language-Image Pre-Training
2//!
3//! Pixtral is an architecture trained for multimodal learning
4//! using images paired with text descriptions.
5//!
6//! - 💻 Transformers Python [reference implementation](https://github.com/huggingface/transformers/tree/main/src/transformers/models/pixtral)
7//! - 📝 [Blog Post](https://mistral.ai/news/pixtral-12b/)
8//! - 🤗 [HF Model Card](https://huggingface.co/mistralai/Pixtral-12B-2409)
9//! - 🤗 [HF Community Model Card](https://huggingface.co/mistral-community/pixtral-12b)
10//!
11//! # Example
12//!
13//! <div align=center>
14//!   <img src="https://github.com/huggingface/candle/raw/main/candle-examples/examples/flux/assets/flux-robot.jpg" alt="" width=320>
15//! </div>
16//!
17//! ```bash
18//! cargo run --profile=release-with-debug \
19//!    --features cuda \
20//!    --example pixtral -- \
21//!    --image candle-examples/examples/flux/assets/flux-robot.jpg
22//! ```
23//!
24//! ```txt
25//! Describe the image.
26//!
27//! The image depicts a charming, rustic robot standing on a sandy beach at sunset.
28//! The robot has a vintage, steampunk aesthetic with visible gears and mechanical
29//! parts. It is holding a small lantern in one hand, which emits a warm glow, and
30//! its other arm is extended forward as if reaching out or guiding the way. The
31//! robot's body is adorned with the word "RUST" in bright orange letters, adding to
32//! its rustic theme.
33//!
34//! The background features a dramatic sky filled with clouds, illuminated by the
35//! setting sun, casting a golden hue over the scene. Gentle waves lap against the
36//! shore, creating a serene and picturesque atmosphere. The overall mood of the
37//! image is whimsical and nostalgic, evoking a sense of adventure and tranquility.
38//! ```
39
40pub mod llava;
41pub mod vision_model;
42
43pub use llava::{Config, Model};