Add support for Idefics 2

[EricLBuehler]

This PR adds support for our first multimodal model: Idefics 2 (https://huggingface.co/HuggingFaceM4/idefics2-8b)!

Implementation TODOs:

• VisionTransformer
  • Encoder
    • Attention
    • MLP
  • VisionEmbedding
• Connector
  • MLP
  • PerceiverLayer
• Model
  • Forward pass
    • Remove padding images
    • Generate the patch/pixel attention mask
    • Run vision submodel and connector submodel
      • Allow Mistral to run trained embedding head on any input tokens
      • Inputs merger to inject embeddings correctly
    • Pass input to Mistral model
      • Allow Mistral to take an embeddings vector instead of using the trained embedding head.
• Image processor analogous to Idefics2ImageProcessor
  • Resizing
  • Rescaling
  • Normalization
  • Padding
    • Generate pixel attention mask for padded images
      • Pass and use in input injection
  • Create pixel values tensors
• Vision Model Pipeline
  • Add a VisionModel trait similar to NormalModel
  • Add a ModelCategory: vision, text, embedding etc
  • Handle sequence scheduling with image dimensions
  • Abstract input preparation logic
    • Handle padding to same, resized shape, across batch dimension
• Add proper handling of chat templates
  • Load preprocessor/processor config JSON files
  • Support configuration of inputs processor via preprocessor
• Messages API generalization
  • Support OpenAI compatible method of specifying images
  • Update messages to optionally encode type (akin to examples here).
  • Use processor config to abstract the chat template application process
• HTTP API
  • Handle decoding from base64
  • Support loading from HTTP.
• Rust API
• Python API

Other TODOs:

• Introduce model type enum to reject mixing of text/multimodal models in speculative decoding
  • Perhaps introduce VisionModel akin to NormalModel.
• Ergonomic API support (OpenAI compatible on the HTTP side, but hopefully nicer on the Rust/Python side)
• Support device mapping
• Support ISQ

Pending issues:

• CUBLAS_STATUS_NOT_SUPPORTED for Conv2d huggingface/candle#2218

[github-actions]

Code Metrics Report

  ===============================================================================
 Language            Files        Lines         Code     Comments       Blanks
===============================================================================
 Dockerfile              1           34           25            0            9
 Happy                   1          442          369            0           73
 JSON                    9           21           21            0            0
 Python                 21          741          622           21           98
 TOML                   15          393          355            1           37
-------------------------------------------------------------------------------
 Jupyter Notebooks       1            0            0            0            0
 |- Markdown             1           60           30           22            8
 |- Python               1           96           87            1            8
 (Total)                            156          117           23           16
-------------------------------------------------------------------------------
 Markdown               16         1054            0          781          273
 |- BASH                 6          203          190            0           13
 |- Python               6          121          110            0           11
 |- Rust                 3          185          172            9            4
 (Total)                           1563          472          790          301
-------------------------------------------------------------------------------
 Rust                   86        28468        26049          381         2038
 |- Markdown            42          440            0          428           12
 (Total)                          28908        26049          809         2050
===============================================================================
 Total                 151        31153        27441         1184         2528
===============================================================================