Turning Database Grading into RL Rewards: Post-Training Agents with ThinkingBox
• 16
AI & ML interests
None defined yet.
Recent Activity
Papers
Breaking Diffusion: Parallel Reasoning with Draft Refinement
OfficeTown: Generative Organizations for Evolving Agent Intelligence
Articles
Collection of Fara1.5 CUA models in three sizes - 4B, 9B and 27B.
A family of safety-aligned instruction models trained with HARC
-
microsoft/HARC
Text Generation • Updated • 10 -
microsoft/HARC-Llama-3.1-8B-Instruct
Text Generation • 8B • Updated • 916 • 4 -
microsoft/HARC-Qwen2.5-7B-Instruct
Text Generation • 8B • Updated • 965 • 8 -
HARC: Coupling Harmfulness and Refusal Directions for Robust Safety Alignment
Paper • 2607.00572 • Published • 4
A family of physical AI models for robotic manipulation
Collection of datasets and models developed to support research in power grid modeling
Accurate and scalable exchange-correlation with deep learning
Frontier Text-to-Speech Models https://microsoft.github.io/VibeVoice/
The models and datasets that comprise the Dayhoff Atlas
Paza is a collection of speech models & benchmarks for low resource languages by the Microsoft Research Africa - Nairobi Lab
Phi-4 family of small language, multi-modal and reasoning models.
-
microsoft/Phi-4-mini-flash-reasoning
Text Generation • 4B • Updated • 2.77k • 291 -
microsoft/Phi-4-mini-reasoning
Text Generation • 4B • Updated • 38k • • 249 -
microsoft/Phi-4-reasoning
Text Generation • 15B • Updated • 29.4k • 232 -
microsoft/Phi-4-reasoning-plus
Text Generation • 15B • Updated • 4.27k • 352
Phi-1 family of small language models.
🔥BitNet family of large language models (1-bit LLMs).
-
microsoft/bitnet-b1.58-2B-4T
Text Generation • 0.8B • Updated • 14.6k • 1.51k -
microsoft/bitnet-b1.58-2B-4T-bf16
Text Generation • 2B • Updated • 3.28k • 51 -
microsoft/bitnet-b1.58-2B-4T-gguf
Text Generation • 2B • Updated • 25.4k • 303 -
BitNet b1.58 2B4T Technical Report
Paper • 2504.12285 • Published • 87
LLM2CLIP makes SOTA pretrained CLIP modal more SOTA ever.
-
microsoft/LLM2CLIP-EVA02-L-14-336
Zero-Shot Image Classification • Updated • 333 • 67 -
microsoft/LLM2CLIP-Openai-L-14-336
Zero-Shot Classification • 0.6B • Updated • 22.3k • 49 -
microsoft/LLM2CLIP-EVA02-B-16
Updated • 251 • 15 -
microsoft/LLM2CLIP-Openai-B-16
Zero-Shot Classification • 0.4B • Updated • 155 • 23
TAPEX is the state-of-the-art table pre-training models which can be used for table-based question answering and table-based fact verification.
-
TAPEX: Table Pre-training via Learning a Neural SQL Executor
Paper • 2107.07653 • Published • 3 -
microsoft/tapex-large-finetuned-wtq
Table Question Answering • 0.4B • Updated • 591 • 84 -
microsoft/tapex-base-finetuned-wikisql
Table Question Answering • Updated • 56.8k • • 39 -
microsoft/tapex-large-sql-execution
Table Question Answering • 0.4B • Updated • 222 • 25
The LayoutLM series are Transformer encoders useful for document AI tasks such as invoice parsing, document image classification and DocVQA.
The Orca family of LMs developed by Microsoft.
GIT (Generative Image-to-text Transformer) is a model useful for vision-language tasks such as image/video captioning and question answering.
-
GIT: A Generative Image-to-text Transformer for Vision and Language
Paper • 2205.14100 • Published • 2 -
microsoft/git-base
Image-to-Text • 0.2B • Updated • 16.3k • 115 -
microsoft/git-large
Image-to-Text • Updated • 900 • 23 -
microsoft/git-base-vqav2
Visual Question Answering • 0.2B • Updated • 877 • 25
Industrial Foundation Models
An open-source agentic app that runs browser and file tasks on small models.
A family of lightweight multimodal models, including understanding and generation.
Microsoft Research - Accurate Chemistry Collection
ChatBench Datasets and Simulators (same prompt + fine-tuning set-up) from the ChatBench paper.
A collection of SLMs based on Phi3.5-mini-instruct adapted to clinical natural language processing tasks: https://arxiv.org/abs/2505.10717
-
A Modular Approach for Clinical SLMs Driven by Synthetic Data with Pre-Instruction Tuning, Model Merging, and Clinical-Tasks Alignment
Paper • 2505.10717 • Published • 5 -
microsoft/MediPhi-Instruct
Text Generation • 4B • Updated • 1.7k • 75 -
microsoft/MediPhi
Text Generation • 4B • Updated • 989 • 29 -
microsoft/MediPhi-PubMed
Text Generation • 4B • Updated • 917 • 19
NextCoder family of code-editing LMs developed with Selective Knowledge Transfer and its training data.
Phi-3 family of small language and multi-modal models. Language models are available in short- and long-context lengths.
-
microsoft/Phi-3.5-mini-instruct
Text Generation • 4B • Updated • 381k • 1.28k -
microsoft/Phi-3.5-MoE-instruct
Text Generation • 42B • Updated • 62.4k • 589 -
microsoft/Phi-3.5-vision-instruct
Image-Text-to-Text • 4B • Updated • 487k • 748 -
microsoft/Phi-3-mini-4k-instruct
Text Generation • 4B • Updated • 342k • • 1.48k
Artifacts for the paper "Controllable Safety Alignment: Inference-Time Adaptation to Diverse Safety Requirements" (https://arxiv.org/abs/2410.08968)
MAI-DS-R1 is a DeepSeek-R1 reasoning model that has been post-trained by the Microsoft AI team.
The SpeechT5 framework consists of a shared seq2seq and six modal-specific (speech/text) pre/post-nets that can address a few audio-related tasks.
The Table Transformer (TATR) is a series of object detection models useful for table extraction from PDF images.
-
microsoft/table-transformer-detection
Object Detection • 28.8M • Updated • 322k • 441 -
microsoft/table-transformer-structure-recognition
Object Detection • 28.8M • Updated • 1.35M • 241 -
microsoft/table-transformer-structure-recognition-v1.1-all
Object Detection • 28.8M • Updated • 156k • 90 -
microsoft/table-transformer-structure-recognition-v1.1-fin
Object Detection • 28.8M • Updated • 711 • 6
Models for biomedical research applications, such as radiology report generation and biomedical language understanding.
UDOP is a general multimodal model for document AI
-
Unifying Vision, Text, and Layout for Universal Document Processing
Paper • 2212.02623 • Published • 12 -
microsoft/udop-large
Image-Text-to-Text • 0.7B • Updated • 9.5k • 129 -
microsoft/udop-large-512
Image-Text-to-Text • 0.7B • Updated • 368 • 11 -
microsoft/udop-large-512-300k
Image-Text-to-Text • 0.7B • Updated • 442 • 40
-
Florence-2: Advancing a Unified Representation for a Variety of Vision Tasks
Paper • 2311.06242 • Published • 98 -
microsoft/Florence-2-large
Image-Text-to-Text • 0.8B • Updated • 377k • 1.88k -
microsoft/Florence-2-base
Image-Text-to-Text • 0.2B • Updated • 3.06M • 431 -
microsoft/Florence-2-large-ft
Image-Text-to-Text • 0.8B • Updated • 46.9k • 397
Locomotion policies for hundreds of simulated humanoid locomotion clips and demonstration data for training them.
Collection of Fara1.5 CUA models in three sizes - 4B, 9B and 27B.
An open-source agentic app that runs browser and file tasks on small models.
A family of safety-aligned instruction models trained with HARC
-
microsoft/HARC
Text Generation • Updated • 10 -
microsoft/HARC-Llama-3.1-8B-Instruct
Text Generation • 8B • Updated • 916 • 4 -
microsoft/HARC-Qwen2.5-7B-Instruct
Text Generation • 8B • Updated • 965 • 8 -
HARC: Coupling Harmfulness and Refusal Directions for Robust Safety Alignment
Paper • 2607.00572 • Published • 4
A family of lightweight multimodal models, including understanding and generation.
A family of physical AI models for robotic manipulation
Collection of datasets and models developed to support research in power grid modeling
Microsoft Research - Accurate Chemistry Collection
Accurate and scalable exchange-correlation with deep learning
ChatBench Datasets and Simulators (same prompt + fine-tuning set-up) from the ChatBench paper.
Frontier Text-to-Speech Models https://microsoft.github.io/VibeVoice/
A collection of SLMs based on Phi3.5-mini-instruct adapted to clinical natural language processing tasks: https://arxiv.org/abs/2505.10717
-
A Modular Approach for Clinical SLMs Driven by Synthetic Data with Pre-Instruction Tuning, Model Merging, and Clinical-Tasks Alignment
Paper • 2505.10717 • Published • 5 -
microsoft/MediPhi-Instruct
Text Generation • 4B • Updated • 1.7k • 75 -
microsoft/MediPhi
Text Generation • 4B • Updated • 989 • 29 -
microsoft/MediPhi-PubMed
Text Generation • 4B • Updated • 917 • 19
The models and datasets that comprise the Dayhoff Atlas
Paza is a collection of speech models & benchmarks for low resource languages by the Microsoft Research Africa - Nairobi Lab
NextCoder family of code-editing LMs developed with Selective Knowledge Transfer and its training data.
Phi-4 family of small language, multi-modal and reasoning models.
-
microsoft/Phi-4-mini-flash-reasoning
Text Generation • 4B • Updated • 2.77k • 291 -
microsoft/Phi-4-mini-reasoning
Text Generation • 4B • Updated • 38k • • 249 -
microsoft/Phi-4-reasoning
Text Generation • 15B • Updated • 29.4k • 232 -
microsoft/Phi-4-reasoning-plus
Text Generation • 15B • Updated • 4.27k • 352
Phi-3 family of small language and multi-modal models. Language models are available in short- and long-context lengths.
-
microsoft/Phi-3.5-mini-instruct
Text Generation • 4B • Updated • 381k • 1.28k -
microsoft/Phi-3.5-MoE-instruct
Text Generation • 42B • Updated • 62.4k • 589 -
microsoft/Phi-3.5-vision-instruct
Image-Text-to-Text • 4B • Updated • 487k • 748 -
microsoft/Phi-3-mini-4k-instruct
Text Generation • 4B • Updated • 342k • • 1.48k
Phi-1 family of small language models.
Artifacts for the paper "Controllable Safety Alignment: Inference-Time Adaptation to Diverse Safety Requirements" (https://arxiv.org/abs/2410.08968)
🔥BitNet family of large language models (1-bit LLMs).
-
microsoft/bitnet-b1.58-2B-4T
Text Generation • 0.8B • Updated • 14.6k • 1.51k -
microsoft/bitnet-b1.58-2B-4T-bf16
Text Generation • 2B • Updated • 3.28k • 51 -
microsoft/bitnet-b1.58-2B-4T-gguf
Text Generation • 2B • Updated • 25.4k • 303 -
BitNet b1.58 2B4T Technical Report
Paper • 2504.12285 • Published • 87
MAI-DS-R1 is a DeepSeek-R1 reasoning model that has been post-trained by the Microsoft AI team.
LLM2CLIP makes SOTA pretrained CLIP modal more SOTA ever.
-
microsoft/LLM2CLIP-EVA02-L-14-336
Zero-Shot Image Classification • Updated • 333 • 67 -
microsoft/LLM2CLIP-Openai-L-14-336
Zero-Shot Classification • 0.6B • Updated • 22.3k • 49 -
microsoft/LLM2CLIP-EVA02-B-16
Updated • 251 • 15 -
microsoft/LLM2CLIP-Openai-B-16
Zero-Shot Classification • 0.4B • Updated • 155 • 23
The SpeechT5 framework consists of a shared seq2seq and six modal-specific (speech/text) pre/post-nets that can address a few audio-related tasks.
TAPEX is the state-of-the-art table pre-training models which can be used for table-based question answering and table-based fact verification.
-
TAPEX: Table Pre-training via Learning a Neural SQL Executor
Paper • 2107.07653 • Published • 3 -
microsoft/tapex-large-finetuned-wtq
Table Question Answering • 0.4B • Updated • 591 • 84 -
microsoft/tapex-base-finetuned-wikisql
Table Question Answering • Updated • 56.8k • • 39 -
microsoft/tapex-large-sql-execution
Table Question Answering • 0.4B • Updated • 222 • 25
The Table Transformer (TATR) is a series of object detection models useful for table extraction from PDF images.
-
microsoft/table-transformer-detection
Object Detection • 28.8M • Updated • 322k • 441 -
microsoft/table-transformer-structure-recognition
Object Detection • 28.8M • Updated • 1.35M • 241 -
microsoft/table-transformer-structure-recognition-v1.1-all
Object Detection • 28.8M • Updated • 156k • 90 -
microsoft/table-transformer-structure-recognition-v1.1-fin
Object Detection • 28.8M • Updated • 711 • 6
The LayoutLM series are Transformer encoders useful for document AI tasks such as invoice parsing, document image classification and DocVQA.
Models for biomedical research applications, such as radiology report generation and biomedical language understanding.
The Orca family of LMs developed by Microsoft.
UDOP is a general multimodal model for document AI
-
Unifying Vision, Text, and Layout for Universal Document Processing
Paper • 2212.02623 • Published • 12 -
microsoft/udop-large
Image-Text-to-Text • 0.7B • Updated • 9.5k • 129 -
microsoft/udop-large-512
Image-Text-to-Text • 0.7B • Updated • 368 • 11 -
microsoft/udop-large-512-300k
Image-Text-to-Text • 0.7B • Updated • 442 • 40
GIT (Generative Image-to-text Transformer) is a model useful for vision-language tasks such as image/video captioning and question answering.
-
GIT: A Generative Image-to-text Transformer for Vision and Language
Paper • 2205.14100 • Published • 2 -
microsoft/git-base
Image-to-Text • 0.2B • Updated • 16.3k • 115 -
microsoft/git-large
Image-to-Text • Updated • 900 • 23 -
microsoft/git-base-vqav2
Visual Question Answering • 0.2B • Updated • 877 • 25
-
Florence-2: Advancing a Unified Representation for a Variety of Vision Tasks
Paper • 2311.06242 • Published • 98 -
microsoft/Florence-2-large
Image-Text-to-Text • 0.8B • Updated • 377k • 1.88k -
microsoft/Florence-2-base
Image-Text-to-Text • 0.2B • Updated • 3.06M • 431 -
microsoft/Florence-2-large-ft
Image-Text-to-Text • 0.8B • Updated • 46.9k • 397
Industrial Foundation Models
Locomotion policies for hundreds of simulated humanoid locomotion clips and demonstration data for training them.