Upload folder using huggingface_hub

Mistral-Small-Instruct-2409-Q2_K.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:be65f58f3931ffbfda359f652072827c8da65aba828c11ae6cfbe3b6556eee93
-size 8272098304
+oid sha256:18856ce4f5c8a9067c9dfbd558b6307310d0c2d9b6c7333272d91ebfa4d770ec
+size 8272098016

Mistral-Small-Instruct-2409-Q3_K_L.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2d27b0ce3896c43c4720224b78b4f641f9d92c61ad66046f707248c82ec1b93d
-size 11730433024
+oid sha256:5063657f82f2bd42cd3bcce94963d50e3cf9e76d71aceb17e7069363e4f4d874
+size 11730432736

Mistral-Small-Instruct-2409-Q3_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6329405d68fa2a7a8bf8e29426fec2fd0ee2cf9147184e7ea84dfbbc54a4af09
-size 10756830208
+oid sha256:8bb16f8f6bfe4baabee93349341a493215d46a1815b8f9d3e7d30b6954aaeaf8
+size 10756829920

Mistral-Small-Instruct-2409-Q3_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6cb4edf4878897b99b0a48f96b314c7f65e3e5a5db07bfd1789df7107988b586
-size 9641276416
+oid sha256:17e0bacadaa647f47821f8b57a13fc9d0d05c1ef2b7a9a545460d75491761822
+size 9641276128

Mistral-Small-Instruct-2409-Q4_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b4c83733d22c1cc1fb168c0aa4ca36848a73ed5aa63a96a136c65d6bbde50763
-size 12569162752
+oid sha256:417edecbad9ac45d87ae9eff83fadc2756190a85aedb5e5599b0ff615eefa79f
+size 12569162464

Mistral-Small-Instruct-2409-Q4_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a85deaab826fc9ed69f09293ad452d1927c673e97751c15ff6b0fa11a1848bb8
-size 13341242368
+oid sha256:2a80bd371f75c1e57715e86b9212587dc7fe0485e20de32f8d5aa6b13e8b865d
+size 13341242080

Mistral-Small-Instruct-2409-Q4_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8d19dfb27c1849de1bf975ce03521c560586c86bad15d2527e4ec67fea92cc94
-size 12660388864
+oid sha256:217cd79082204fe63fc306133de9db8f8f221a58f741355b0af0e05d001ac508
+size 12660388576

Mistral-Small-Instruct-2409-Q5_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5cf50d5d673f48e9be7e75dd712425bd87ea542544908a95e98e5aec823dc376
-size 15324820480
+oid sha256:6cd49643094e87226324fbbdfe4c20c4173c7b7b7459a47400280974fe1102c1
+size 15324820192

Mistral-Small-Instruct-2409-Q5_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6179fa41debe7f228810a162d7acee259813aa5134c19753c56e0dbeb6b4129e
-size 15722558464
+oid sha256:73fdcea67f85c61c72131c31514ae9baa47a8aa658b0beee7c6934cf170fe304
+size 15722558176

Mistral-Small-Instruct-2409-Q5_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:aa5bde5318994925e26a9d31964c443cac1c92cc3d0e21de7ca00b0fa3d09698
-size 15324820480
+oid sha256:7f128c865ee858720ed34565676429cb03d3a3a6eba19f48eeb1b991788c650c
+size 15324820192

Mistral-Small-Instruct-2409-Q6_K.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a789aeb9938853b6eaaf16b3a406d5261cb93920571b750bc76ba3be7759880b
-size 18252706816
+oid sha256:b2e4cdd47571aeba0d1a0ee56d20cc271e369f969ad932af1c6aa9762132a3e7
+size 18252706528

Mistral-Small-Instruct-2409-Q8_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9735fc4ccc53aa27e88a87d748e926ffdf0603b3a473d86e2c10554dd5b97866
-size 23640552448
+oid sha256:6f151fbef25bd5eb69478b7944c8bf0f9e6d6a6ea063362d3b034697ead27328
+size 23640552160

README.md

@@ -1,11 +1,248 @@
 ---
-base_model: unsloth/Mistral-Small-Instruct-2409
+language:
+- en
+- fr
+- de
+- es
+- it
+- pt
+- zh
+- ja
+- ru
+- ko
 license: other
 license_name: mrl
+inference: false
 license_link: https://mistral.ai/licenses/MRL-0.1.md
+extra_gated_prompt: '# Mistral AI Research License
+
+  If You want to use a Mistral Model, a Derivative or an Output for any purpose that
+  is not expressly authorized under this Agreement, You must request a license from
+  Mistral AI, which Mistral AI may grant to You in Mistral AI''s sole discretion.
+  To discuss such a license, please contact Mistral AI via the website contact form:
+  https://mistral.ai/contact/
+
+  ## 1. Scope and acceptance
+
+  **1.1. Scope of the Agreement.** This Agreement applies to any use, modification,
+  or Distribution of any Mistral Model by You, regardless of the source You obtained
+  a copy of such Mistral Model.
+
+  **1.2. Acceptance.** By accessing, using, modifying, Distributing a Mistral Model,
+  or by creating, using or distributing a Derivative of the Mistral Model, You agree
+  to be bound by this Agreement.
+
+  **1.3. Acceptance on behalf of a third-party.** If You accept this Agreement on
+  behalf of Your employer or another person or entity, You warrant and represent that
+  You have the authority to act and accept this Agreement on their behalf. In such
+  a case, the word "You" in this Agreement will refer to Your employer or such other
+  person or entity.
+
+  ## 2. License
+
+  **2.1. Grant of rights**.  Subject to Section 3 below, Mistral AI hereby grants
+  You a non-exclusive, royalty-free, worldwide, non-sublicensable, non-transferable,
+  limited license to use, copy, modify, and Distribute under the conditions provided
+  in Section 2.2 below, the Mistral Model and any Derivatives made by or for Mistral
+  AI and to create Derivatives of the Mistral Model.
+
+  **2.2. Distribution of Mistral Model and Derivatives made by or for Mistral AI.**
+  Subject to Section 3 below, You may Distribute copies of the Mistral Model and/or
+  Derivatives made by or for Mistral AI, under the following conditions: You must
+  make available a copy of this Agreement to third-party recipients of the Mistral
+  Models and/or Derivatives made by or for Mistral AI you Distribute, it being specified
+  that any rights to use the Mistral Models and/or Derivatives made by or for Mistral
+  AI shall be directly granted by Mistral AI to said third-party recipients pursuant
+  to the Mistral AI Research License agreement executed between these parties; You
+  must retain in all copies of the Mistral Models the following attribution notice
+  within a "Notice" text file distributed as part of such copies: "Licensed by Mistral
+  AI under the Mistral AI Research License".
+
+  **2.3. Distribution of Derivatives made by or for You.** Subject to Section 3 below,
+  You may Distribute any Derivatives made by or for You under additional or different
+  terms and conditions, provided that: In any event, the use and modification of Mistral
+  Model and/or Derivatives made by or for Mistral AI shall remain governed by the
+  terms and conditions of this Agreement; You include in any such Derivatives made
+  by or for You prominent notices stating that You modified the concerned Mistral
+  Model; and Any terms and conditions You impose on any third-party recipients relating
+  to Derivatives made by or for You shall neither limit such third-party recipients''
+  use of the Mistral Model or any Derivatives made by or for Mistral AI in accordance
+  with the Mistral AI Research License nor conflict with any of its terms and conditions.
+
+  ## 3. Limitations
+
+  **3.1. Misrepresentation.** You must not misrepresent or imply, through any means,
+  that the Derivatives made by or for You and/or any modified version of the Mistral
+  Model You Distribute under your name and responsibility is an official product of
+  Mistral AI or has been endorsed, approved or validated by Mistral AI, unless You
+  are authorized by Us to do so in writing.
+
+  **3.2. Usage Limitation.** You shall only use the Mistral Models, Derivatives (whether
+  or not created by Mistral AI) and Outputs for Research Purposes.
+
+  ## 4. Intellectual Property
+
+  **4.1. Trademarks.** No trademark licenses are granted under this Agreement, and
+  in connection with the Mistral Models, You may not use any name or mark owned by
+  or associated with Mistral AI or any of its affiliates, except (i) as required for
+  reasonable and customary use in describing and Distributing the Mistral Models and
+  Derivatives made by or for Mistral AI and (ii) for attribution purposes as required
+  by this Agreement.
+
+  **4.2. Outputs.** We claim no ownership rights in and to the Outputs. You are solely
+  responsible for the Outputs You generate and their subsequent uses in accordance
+  with this Agreement. Any Outputs shall be subject to the restrictions set out in
+  Section 3 of this Agreement.
+
+  **4.3. Derivatives.** By entering into this Agreement, You accept that any Derivatives
+  that You may create or that may be created for You shall be subject to the restrictions
+  set out in Section 3 of this Agreement.
+
+  ## 5. Liability
+
+  **5.1. Limitation of liability.** In no event, unless required by applicable law
+  (such as deliberate and grossly negligent acts) or agreed to in writing, shall Mistral
+  AI be liable to You for damages, including any direct, indirect, special, incidental,
+  or consequential damages of any character arising as a result of this Agreement
+  or out of the use or inability to use the Mistral Models and Derivatives (including
+  but not limited to damages for loss of data, loss of goodwill, loss of expected
+  profit or savings, work stoppage, computer failure or malfunction, or any damage
+  caused by malware or security breaches), even if  Mistral AI has been advised of
+  the possibility of such damages.
+
+  **5.2. Indemnification.** You agree to indemnify and hold harmless Mistral AI from
+  and against any claims, damages, or losses arising out of or related to Your use
+  or Distribution of the Mistral Models and Derivatives.
+
+  ## 6. Warranty
+
+  **6.1. Disclaimer.** Unless required by applicable law or prior agreed to by Mistral
+  AI in writing, Mistral AI provides the Mistral Models and Derivatives on an "AS
+  IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied,
+  including, without limitation, any warranties or conditions of TITLE, NON-INFRINGEMENT,
+  MERCHANTABILITY, or FITNESS FOR A PARTICULAR PURPOSE. Mistral AI does not represent
+  nor warrant that the Mistral Models and Derivatives will be error-free, meet Your
+  or any third party''s requirements, be secure or will allow You or any third party
+  to achieve any kind of result or generate any kind of content. You are solely responsible
+  for determining the appropriateness of using or Distributing the Mistral Models
+  and Derivatives and assume any risks associated with Your exercise of rights under
+  this Agreement.
+
+  ## 7. Termination
+
+  **7.1. Term.** This Agreement is effective as of the date of your acceptance of
+  this Agreement or access to the concerned Mistral Models or Derivatives and will
+  continue until terminated in accordance with the following terms.
+
+  **7.2. Termination.** Mistral AI may terminate this Agreement at any time if You
+  are in breach of this Agreement. Upon termination of this Agreement, You must cease
+  to use all Mistral Models and Derivatives and shall permanently delete any copy
+  thereof. The following provisions, in their relevant parts, will survive any termination
+  or expiration of this Agreement, each for the duration necessary to achieve its
+  own intended purpose (e.g. the liability provision will survive until the end of
+  the applicable limitation period):Sections 5 (Liability), 6(Warranty), 7 (Termination)
+  and 8 (General Provisions).
+
+  **7.3. Litigation.** If You initiate any legal action or proceedings against Us
+  or any other entity (including a cross-claim or counterclaim in a lawsuit), alleging
+  that the Model or a Derivative, or any part thereof, infringe upon intellectual
+  property or other rights owned or licensable by You, then any licenses granted to
+  You under this Agreement will immediately terminate as of the date such legal action
+  or claim is filed or initiated.
+
+  ## 8. General provisions
+
+  **8.1. Governing laws.** This Agreement will be governed by the laws of France,
+  without regard to choice of law principles, and the UN Convention on Contracts for
+  the International Sale of Goods does not apply to this Agreement.
+
+  **8.2. Competent jurisdiction.** The courts of Paris shall have exclusive jurisdiction
+  of any dispute arising out of this Agreement.
+
+  **8.3. Severability.** If any provision of this Agreement is held to be invalid,
+  illegal or unenforceable, the remaining provisions shall be unaffected thereby and
+  remain valid as if such provision had not been set forth herein.
+
+  ## 9. Definitions
+
+  "Agreement": means this Mistral AI Research License agreement governing the access,
+  use, and Distribution of the Mistral Models, Derivatives and Outputs.
+
+  "Derivative": means any (i) modified version of the Mistral Model (including but
+  not limited to any customized or fine-tuned version thereof), (ii) work based on
+  the Mistral Model, or (iii) any other derivative work thereof.
+
+  "Distribution", "Distributing", "Distribute" or "Distributed": means supplying,
+  providing or making available, by any means, a copy of the Mistral Models and/or
+  the Derivatives as the case may be, subject to Section 3 of this Agreement.
+
+  "Mistral AI", "We" or "Us": means Mistral AI, a French société par actions simplifiée
+  registered in the Paris commercial registry under the number 952 418 325, and having
+  its registered seat at 15, rue des Halles, 75001 Paris.
+
+  "Mistral Model": means the foundational large language model(s), and its elements
+  which include algorithms, software, instructed checkpoints, parameters, source code
+  (inference code, evaluation code and, if applicable, fine-tuning code) and any other
+  elements associated thereto made available by Mistral AI under this Agreement, including,
+  if any, the technical documentation, manuals and instructions for the use and operation
+  thereof.
+
+  "Research Purposes": means any use of a Mistral Model,  Derivative, or Output that
+  is solely for (a) personal, scientific or academic research, and (b) for non-profit
+  and non-commercial purposes, and not directly or indirectly connected to any commercial
+  activities or business operations. For illustration purposes, Research Purposes
+  does not include (1) any usage of the Mistral Model, Derivative or Output by individuals
+  or contractors employed in or engaged by companies in the context of (a) their daily
+  tasks, or (b) any activity (including but not limited to any testing or proof-of-concept)
+  that is intended to generate revenue, nor (2) any Distribution by a commercial entity
+  of the Mistral Model, Derivative or Output whether in return for payment or free
+  of charge, in any medium or form, including but not limited to through a hosted
+  or managed service (e.g. SaaS, cloud instances, etc.), or behind a software layer.
+
+  "Outputs": means any content generated by the operation of the Mistral Models or
+  the Derivatives from  a prompt (i.e., text instructions) provided by users. For
+  the avoidance of doubt, Outputs do not include any components of a Mistral Models,
+  such as any fine-tuned versions of the Mistral Models, the weights, or parameters.
+
+  "You": means the individual or entity entering into this Agreement with Mistral
+  AI.
+
+
+  *Mistral AI processes your personal data below to provide the model and enforce
+  its license. If you are affiliated with a commercial entity, we may also send you
+  communications about our models. For more information on your rights and data handling,
+  please see our <a href="https://mistral.ai/terms/">privacy policy</a>.*'
+extra_gated_fields:
+  First Name: text
+  Last Name: text
+  Country: country
+  Affiliation: text
+  Job title: text
+  I understand that I can only use the model, any derivative versions and their outputs for non-commercial research purposes: checkbox
+  ? I understand that if I am a commercial entity, I am not permitted to use or distribute
+    the model internally or externally, or expose it in my own offerings without a
+    commercial license
+  : checkbox
+  ? I understand that if I upload the model, or any derivative version, on any platform,
+    I must include the Mistral Research License
+  : checkbox
+  ? I understand that for commercial use of the model, I can contact Mistral or use
+    the Mistral AI API on la Plateforme or any of our cloud provider partners
+  : checkbox
+  ? By clicking Submit below I accept the terms of the license and acknowledge that
+    the information I provide will be collected stored processed and shared in accordance
+    with the Mistral Privacy Policy
+  : checkbox
+  geo: ip_location
+extra_gated_description: Mistral AI processes your personal data below to provide
+  the model and enforce its license. If you are affiliated with a commercial entity,
+  we may also send you communications about our models. For more information on your
+  rights and data handling, please see our <a href="https://mistral.ai/terms/">privacy
+  policy</a>.
+extra_gated_button_content: Submit
+library_name: vllm
+base_model: mistralai/Mistral-Small-Instruct-2409
 tags:
-- unsloth
-- mistral
 - TensorBlock
 - GGUF
 ---
@@ -21,11 +258,11 @@ tags:
     </div>
 </div>
 
-## unsloth/Mistral-Small-Instruct-2409 - GGUF
+## mistralai/Mistral-Small-Instruct-2409 - GGUF
 
-This repo contains GGUF format model files for [unsloth/Mistral-Small-Instruct-2409](https://huggingface.co/unsloth/Mistral-Small-Instruct-2409).
+This repo contains GGUF format model files for [mistralai/Mistral-Small-Instruct-2409](https://huggingface.co/mistralai/Mistral-Small-Instruct-2409).
 
-The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit ec7f3ac](https://github.com/ggerganov/llama.cpp/commit/ec7f3ac9ab33e46b136eb5ab6a76c4d81f57c7f1).
 
 <div style="text-align: left; margin: 20px 0;">
     <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">