Add files using upload-large-folder tool

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,204 @@
+---
+library_name: mlx
+language:
+- ar
+- de
+- en
+- es
+- fr
+- hi
+- id
+- it
+- pt
+- th
+- tl
+- vi
+tags:
+- facebook
+- meta
+- pytorch
+- llama
+- llama-4
+- mlx
+extra_gated_prompt: '**LLAMA 4 COMMUNITY LICENSE AGREEMENT**
+
+  Llama 4 Version Effective Date: April 5, 2025
+
+  "**Agreement**" means the terms and conditions for use, reproduction, distribution
+  and modification of the Llama Materials set forth herein.
+
+  "**Documentation**" means the specifications, manuals and documentation accompanying
+  Llama 4 distributed by Meta at [https://www.llama.com/docs/overview](https://llama.com/docs/overview).
+
+  "**Licensee**" or "**you**" means you, or your employer or any other person or entity
+  (if you are entering into this Agreement on such person or entity’s behalf), of
+  the age required under applicable laws, rules or regulations to provide legal consent
+  and that has legal authority to bind your employer or such other person or entity
+  if you are entering in this Agreement on their behalf.
+
+  "**Llama 4**" means the foundational large language models and software and algorithms,
+  including machine-learning model code, trained model weights, inference-enabling
+  code, training-enabling code, fine-tuning enabling code and other elements of the
+  foregoing distributed by Meta at [https://www.llama.com/llama-downloads](https://www.llama.com/llama-downloads).
+
+  "**Llama Materials**" means, collectively, Meta’s proprietary Llama 4 and Documentation
+  (and any portion thereof) made available under this Agreement.
+
+  "**Meta**" or "**we**" means Meta Platforms Ireland Limited (if you are located
+  in or, if you are an entity, your principal place of business is in the EEA or Switzerland)
+  and Meta Platforms, Inc. (if you are located outside of the EEA or Switzerland). 
+
+  By clicking "I Accept" below or by using or distributing any portion or element
+  of the Llama Materials, you agree to be bound by this Agreement.
+
+  1\. **License Rights and Redistribution**.
+
+  a. Grant of Rights. You are granted a non-exclusive, worldwide, non-transferable
+  and royalty-free limited license under Meta’s intellectual property or other rights
+  owned by Meta embodied in the Llama Materials to use, reproduce, distribute, copy,
+  create derivative works of, and make modifications to the Llama Materials.  
+
+  b. Redistribution and Use.  
+
+  i. If you distribute or make available the Llama Materials (or any derivative works
+  thereof), or a product or service (including another AI model) that contains any
+  of them, you shall (A) provide a copy of this Agreement with any such Llama Materials;
+  and (B) prominently display "Built with Llama" on a related website, user interface,
+  blogpost, about page, or product documentation. If you use the Llama Materials or
+  any outputs or results of the Llama Materials to create, train, fine tune, or otherwise
+  improve an AI model, which is distributed or made available, you shall also include
+  "Llama" at the beginning of any such AI model name.
+
+  ii. If you receive Llama Materials, or any derivative works thereof, from a Licensee
+  as part of an integrated end user product, then Section 2 of this Agreement will
+  not apply to you. 
+
+  iii. You must retain in all copies of the Llama Materials that you distribute the
+  following attribution notice within a "Notice" text file distributed as a part of
+  such copies: "Llama 4 is licensed under the Llama 4 Community License, Copyright
+  © Meta Platforms, Inc. All Rights Reserved."
+
+  iv. Your use of the Llama Materials must comply with applicable laws and regulations
+  (including trade compliance laws and regulations) and adhere to the Acceptable Use
+  Policy for the Llama Materials (available at [https://www.llama.com/llama4/use-policy](https://www.llama.com/llama4/use-policy)),
+  which is hereby incorporated by reference into this Agreement.        2\. **Additional
+  Commercial Terms**. If, on the Llama 4 version release date, the monthly active
+  users of the products or services made available by or for Licensee, or Licensee’s
+  affiliates, is greater than 700 million monthly active users in the preceding calendar
+  month, you must request a license from Meta, which Meta may grant to you in its
+  sole discretion, and you are not authorized to exercise any of the rights under
+  this Agreement unless or until Meta otherwise expressly grants you such rights.
+
+  3**. Disclaimer of Warranty**. UNLESS REQUIRED BY APPLICABLE LAW, THE LLAMA MATERIALS
+  AND ANY OUTPUT AND RESULTS THEREFROM ARE PROVIDED ON AN "AS IS" BASIS, WITHOUT WARRANTIES
+  OF ANY KIND, AND META DISCLAIMS ALL WARRANTIES OF ANY KIND, BOTH EXPRESS AND IMPLIED,
+  INCLUDING, WITHOUT LIMITATION, ANY WARRANTIES OF TITLE, NON-INFRINGEMENT, MERCHANTABILITY,
+  OR FITNESS FOR A PARTICULAR PURPOSE. YOU ARE SOLELY RESPONSIBLE FOR DETERMINING
+  THE APPROPRIATENESS OF USING OR REDISTRIBUTING THE LLAMA MATERIALS AND ASSUME ANY
+  RISKS ASSOCIATED WITH YOUR USE OF THE LLAMA MATERIALS AND ANY OUTPUT AND RESULTS.
+
+  4\. **Limitation of Liability**. IN NO EVENT WILL META OR ITS AFFILIATES BE LIABLE
+  UNDER ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, TORT, NEGLIGENCE, PRODUCTS LIABILITY,
+  OR OTHERWISE, ARISING OUT OF THIS AGREEMENT, FOR ANY LOST PROFITS OR ANY INDIRECT,
+  SPECIAL, CONSEQUENTIAL, INCIDENTAL, EXEMPLARY OR PUNITIVE DAMAGES, EVEN IF META
+  OR ITS AFFILIATES HAVE BEEN ADVISED OF THE POSSIBILITY OF ANY OF THE FOREGOING.
+
+  5\. **Intellectual Property**.
+
+  a. No trademark licenses are granted under this Agreement, and in connection with
+  the Llama Materials, neither Meta nor Licensee may use any name or mark owned by
+  or associated with the other or any of its affiliates, except as required for reasonable
+  and customary use in describing and redistributing the Llama Materials or as set
+  forth in this Section 5(a). Meta hereby grants you a license to use "Llama" (the
+  "Mark") solely as required to comply with the last sentence of Section 1.b.i. You
+  will comply with Meta’s brand guidelines (currently accessible at [https://about.meta.com/brand/resources/meta/company-brand/](https://about.meta.com/brand/resources/meta/company-brand/)[)](https://en.facebookbrand.com/).
+  All goodwill arising out of your use of the Mark will inure to the benefit of Meta.
+
+  b. Subject to Meta’s ownership of Llama Materials and derivatives made by or for
+  Meta, with respect to any derivative works and modifications of the Llama Materials
+  that are made by you, as between you and Meta, you are and will be the owner of
+  such derivative works and modifications.
+
+  c. If you institute litigation or other proceedings against Meta or any entity (including
+  a cross-claim or counterclaim in a lawsuit) alleging that the Llama Materials or
+  Llama 4 outputs or results, or any portion of any of the foregoing, constitutes
+  infringement of intellectual property or other rights owned or licensable by you,
+  then any licenses granted to you under this Agreement shall terminate as of the
+  date such litigation or claim is filed or instituted. You will indemnify and hold
+  harmless Meta from and against any claim by any third party arising out of or related
+  to your use or distribution of the Llama Materials.
+
+  6\. **Term and Termination**. The term of this Agreement will commence upon your
+  acceptance of this Agreement or access to the Llama Materials and will continue
+  in full force and effect until terminated in accordance with the terms and conditions
+  herein. Meta may terminate this Agreement if you are in breach of any term or condition
+  of this Agreement. Upon termination of this Agreement, you shall delete and cease
+  use of the Llama Materials. Sections 3, 4 and 7 shall survive the termination of
+  this Agreement. 
+
+  7\. **Governing Law and Jurisdiction**. This Agreement will be governed and construed
+  under the laws of the State of California without regard to choice of law principles,
+  and the UN Convention on Contracts for the International Sale of Goods does not
+  apply to this Agreement. The courts of California shall have exclusive jurisdiction
+  of any dispute arising out of this Agreement.'
+extra_gated_fields:
+  First Name: text
+  Last Name: text
+  Date of birth: date_picker
+  Country: country
+  Affiliation: text
+  Job title:
+    type: select
+    options:
+    - Student
+    - Research Graduate
+    - AI researcher
+    - AI developer/engineer
+    - Reporter
+    - Other
+  geo: ip_location
+  ? By clicking Submit below I accept the terms of the license and acknowledge that
+    the information I provide will be collected stored processed and shared in accordance
+    with the Meta Privacy Policy
+  : checkbox
+extra_gated_description: The information you provide will be collected, stored, processed
+  and shared in accordance with the [Meta Privacy Policy](https://www.facebook.com/privacy/policy/).
+extra_gated_button_content: Submit
+extra_gated_heading: Please be sure to provide your full legal name, date of birth,
+  and full organization name with all corporate identifiers. Avoid the use of acronyms
+  and special characters. Failure to follow these instructions may prevent you from
+  accessing this model and others on Hugging Face. You will not have the ability to
+  edit this form after submission, so please ensure all information is accurate.
+license: other
+license_name: llama4
+base_model: meta-llama/Llama-4-Scout-17B-16E
+pipeline_tag: text-generation
+---
+
+# mlx-community/meta-llama-Llama-4-Scout-17B-16E-8bit
+
+This model [mlx-community/meta-llama-Llama-4-Scout-17B-16E-8bit](https://huggingface.co/mlx-community/meta-llama-Llama-4-Scout-17B-16E-8bit) was
+converted to MLX format from [meta-llama/Llama-4-Scout-17B-16E](https://huggingface.co/meta-llama/Llama-4-Scout-17B-16E)
+using mlx-lm version **0.22.3**.
+
+## Use with mlx
+
+```bash
+pip install mlx-lm
+```
+
+```python
+from mlx_lm import load, generate
+
+model, tokenizer = load("mlx-community/meta-llama-Llama-4-Scout-17B-16E-8bit")
+
+prompt = "hello"
+
+if tokenizer.chat_template is not None:
+    messages = [{"role": "user", "content": prompt}]
+    prompt = tokenizer.apply_chat_template(
+        messages, add_generation_prompt=True
+    )
+
+response = generate(model, tokenizer, prompt=prompt, verbose=True)
+```

config.json

@@ -0,0 +1,85 @@
+{
+    "architectures": [
+        "Llama4ForConditionalGeneration"
+    ],
+    "boi_token_index": 200080,
+    "eoi_token_index": 200081,
+    "image_token_index": 200092,
+    "model_type": "llama4",
+    "quantization": {
+        "group_size": 64,
+        "bits": 8
+    },
+    "quantization_config": {
+        "group_size": 64,
+        "bits": 8
+    },
+    "text_config": {
+        "attention_bias": false,
+        "attention_chunk_size": 8192,
+        "attention_dropout": 0.0,
+        "bos_token_id": 200000,
+        "eos_token_id": [
+            200001,
+            200007,
+            200008
+        ],
+        "for_llm_compressor": false,
+        "head_dim": 128,
+        "hidden_act": "silu",
+        "hidden_size": 5120,
+        "initializer_range": 0.02,
+        "interleave_moe_layer_step": 1,
+        "intermediate_size": 8192,
+        "intermediate_size_mlp": 16384,
+        "max_position_embeddings": 262144,
+        "model_type": "llama4_text",
+        "no_rope_layers": [],
+        "num_attention_heads": 40,
+        "num_experts_per_tok": 1,
+        "num_hidden_layers": 48,
+        "num_key_value_heads": 8,
+        "num_local_experts": 16,
+        "output_router_logits": false,
+        "pad_token_id": 200018,
+        "rms_norm_eps": 1e-05,
+        "rope_scaling": {
+            "factor": 8.0,
+            "high_freq_factor": 4.0,
+            "low_freq_factor": 1.0,
+            "original_max_position_embeddings": 8192,
+            "rope_type": "llama3"
+        },
+        "rope_theta": 500000.0,
+        "router_aux_loss_coef": 0.001,
+        "router_jitter_noise": 0.0,
+        "torch_dtype": "bfloat16",
+        "use_cache": true,
+        "use_qk_norm": true,
+        "vocab_size": 202048
+    },
+    "transformers_version": "4.51.0.dev0",
+    "vision_config": {
+        "attention_dropout": 0.0,
+        "hidden_act": "gelu",
+        "hidden_size": 1408,
+        "image_size": 336,
+        "initializer_range": 0.02,
+        "intermediate_size": 5632,
+        "model_type": "llama4_vision_model",
+        "multi_modal_projector_bias": false,
+        "norm_eps": 1e-05,
+        "num_attention_heads": 16,
+        "num_channels": 3,
+        "num_hidden_layers": 34,
+        "patch_size": 14,
+        "pixel_shuffle_ratio": 0.5,
+        "projector_dropout": 0.0,
+        "projector_input_dim": 4096,
+        "projector_output_dim": 4096,
+        "rope_theta": 10000,
+        "vision_feature_layer": -1,
+        "vision_feature_select_strategy": "default",
+        "vision_output_dim": 4096
+    }
+}

model-00001-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b7957a7eea5278001c054b9b10f21d66402634ccc1ff6aae2eea4068781c84d2
+size 4931801590

model-00002-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0655fcf15b035e6d68fa8f344e1446004bd2c6e75f4ff51f07016fc2fe904216
+size 5350583948

model-00003-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:436acee90c15e7a1ba662edb5598c3a527f3d575301543f9ab50dedaf5978e60
+size 4922089698

model-00004-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:43b7230b0daa52bd0dcc41e12ac3fdd3c04be63d7e1f461c008fca723d3b5a98
+size 5350583958

model-00005-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a91970ec13f8883a3c8aa2a7953d73387fcdd6a6a08e92a7866cc7d76d07b0d0
+size 4721438501

model-00006-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f2fab2113283420863c96dcc7e18b02955742ddc6013be4b8bc8ca973c8d2bf5
+size 5350584015

model-00007-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:39a3ab3909c1fe69670589d54ac58c0d011ed38be31e0707025728c5ec08332d
+size 4721438580

model-00008-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2eed72a138c8655faaae6d95422aac2f662589a1c426d781069c9145b0da92ef
+size 5350584057

model-00009-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:baf07304eb9559dded61e078153c8580c9a0f4e8f6c9866a43cfa97dca656aa8
+size 4922089776

model-00010-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:94cfc18bcc0dc0224ab352b8814fcfddee148f27dedb81f0d344533ef49c75d9
+size 5350584035

model-00011-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:41e0f8b4d973270ad032648a20a36d1df4c49f23f7908d8ebc074855c2201790
+size 4721438530

model-00012-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:af57afeda9818c288df3aa4af5e5efc2289f9531ca74077094d2d38d435c384a
+size 5350584059

model-00013-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7c34d2541aec5abbf34334bab927e89d1a6c545a3afb0fb78c12c4f5e5579b2d
+size 4721438582

model-00014-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:578adf130c292580e4e8ecd2595f4dd924236cce1eac048fde736ae2a4ceceef
+size 5350584061

model-00015-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:99bc02fa71808ad169c82489ebf803bb828d02e10f3120a8774b21561ffad48f
+size 4922089744

model-00016-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:99fc943c650be698564db49dbb5c311852572634447abdc97e459819a35e9f6c
+size 5350584025

model-00017-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f6d9011620134a1b1ee5df4233c78b4fd98a06fd285c74abd9b06e00531b8120
+size 4721438558

model-00018-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1ad06a0e8ec65a2e804d1acd5ec957cd73eb9faaa261670c7506be76b2cba1b5
+size 5350583983

model-00019-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:92bf7a089e609c1bd48b9efc7814e57767676970541a39d6381dfe5104f024b4
+size 4721438554

model-00020-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3d1516e8f311d87ad205695e7cfce1a49b3272ff054b7882c0c07268084711d4
+size 5350584051

model-00021-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2c63c5e8dba009ed85b2ef73279f6ef6f33e288a1d8c55643fbe92660373efc2
+size 4922089766

model-00022-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:933636a0f53edbdbf0cad88d19b838ebb8a73582bba62f4cc4edb6bf602573e3
+size 5350583971

model-00023-of-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0b1b5fe8ea9e0a2ac14c861e8c567c8338006caca2e9c5fa230ade8ba1fed234
+size 2700962360

special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<|begin_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|eot|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|finetune_right_pad_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:172c9eb4beafc72601690da3ccfcede5c2e6806a8d5ec1fca33e22acea8023a4
+size 27948578