Update README.md: Add model card metadata, ImageNet-1k metrics, and LiteRT usage example

#1
Files changed (1) hide show
  1. README.md +139 -0
README.md CHANGED
@@ -1,8 +1,147 @@
1
  ---
2
  library_name: litert
 
3
  tags:
4
  - vision
5
  - image-classification
 
 
6
  datasets:
7
  - imagenet-1k
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  library_name: litert
3
+ pipeline_tag: image-classification
4
  tags:
5
  - vision
6
  - image-classification
7
+ - google
8
+ - computer-vision
9
  datasets:
10
  - imagenet-1k
11
+ model-index:
12
+ - name: litert-community/vgg16_bn
13
+ results:
14
+ - task:
15
+ type: image-classification
16
+ name: Image Classification
17
+ dataset:
18
+ name: ImageNet-1k
19
+ type: imagenet-1k
20
+ config: default
21
+ split: validation
22
+ metrics:
23
+ - name: Top 1 Accuracy (Full Precision)
24
+ type: accuracy
25
+ value: 0.7343
26
+ - name: Top 5 Accuracy (Full Precision)
27
+ type: accuracy
28
+ value: 0.9151
29
  ---
30
+
31
+ # VGG16_BN
32
+
33
+ VGG16_BN model pre-trained on ImageNet-1k. Originally introduced by Karen Simonyan and Andrew Zisserman in the influential paper, [**Very Deep Convolutional Networks for Large-Scale Image Recognition**](https://arxiv.org/abs/1409.1556) this version enhances the 16-layer architecture by incorporating Batch Normalization after each convolutional layer.
34
+
35
+ ## Model description
36
+
37
+ The model was converted from a checkpoint from PyTorch Vision.
38
+
39
+ The original model has:
40
+ acc@1 (on ImageNet-1K): 73.36%
41
+ acc@5 (on ImageNet-1K): 91.516%
42
+ num_params: 138365992
43
+
44
+ ## Intended uses & limitations
45
+
46
+ The model files were converted from pretrained weights from PyTorch Vision. The models may have their own licenses or terms and conditions derived from PyTorch Vision and the dataset used for training. It is your responsibility to determine whether you have permission to use the models for your use case.
47
+
48
+
49
+ ## How to Use
50
+
51
+ ​​**1. Install Dependencies**
52
+
53
+ Ensure your Python environment is set up with the required libraries. Run the following command in your terminal
54
+
55
+ ```bash
56
+ pip install numpy Pillow huggingface_hub ai-edge-litert
57
+ ```
58
+
59
+ **2. Prepare Your Image**
60
+
61
+ The script expects an image file to analyze. Make sure you have an image (e.g., cat.jpg or car.png) saved in the same working directory as your script.
62
+
63
+
64
+ **3. Save the Script**
65
+
66
+ Create a new file named `classify.py`, paste the script below into it, and save the file
67
+
68
+ ```python
69
+ #!/usr/bin/env python3
70
+ import argparse, json
71
+ import numpy as np
72
+ from PIL import Image
73
+ from huggingface_hub import hf_hub_download
74
+ from ai_edge_litert.compiled_model import CompiledModel
75
+
76
+ def preprocess(img: Image.Image) -> np.ndarray:
77
+ img = img.convert("RGB")
78
+ w, h = img.size
79
+ s = 256
80
+ if w < h:
81
+ img = img.resize((s, int(round(h * s / w))), Image.BILINEAR)
82
+ else:
83
+ img = img.resize((int(round(w * s / h)), s), Image.BILINEAR)
84
+ left = (img.size[0] - 224) // 2
85
+ top = (img.size[1] - 224) // 2
86
+ img = img.crop((left, top, left + 224, top + 224))
87
+
88
+ x = np.asarray(img, dtype=np.float32) / 255.0
89
+ x = (x - np.array([0.485, 0.456, 0.406], dtype=np.float32)) / np.array(
90
+ [0.229, 0.224, 0.225], dtype=np.float32
91
+ )
92
+ return np.expand_dims(x, axis=0)
93
+
94
+ def main():
95
+ ap = argparse.ArgumentParser()
96
+ ap.add_argument("--image", required=True)
97
+ args = ap.parse_args()
98
+
99
+ model_path = hf_hub_download("litert-community/vgg16_bn", "vgg16_bn.tflite")
100
+ labels_path = hf_hub_download(
101
+ "huggingface/label-files", "imagenet-1k-id2label.json", repo_type="dataset"
102
+ )
103
+ with open(labels_path, "r", encoding="utf-8") as f:
104
+ id2label = {int(k): v for k, v in json.load(f).items()}
105
+
106
+ img = Image.open(args.image)
107
+ x = preprocess(img)
108
+
109
+ model = CompiledModel.from_file(model_path)
110
+ inp = model.create_input_buffers(0)
111
+ out = model.create_output_buffers(0)
112
+
113
+ inp[0].write(x)
114
+ model.run_by_index(0, inp, out)
115
+
116
+ req = model.get_output_buffer_requirements(0, 0)
117
+ y = out[0].read(req["buffer_size"] // np.dtype(np.float32).itemsize, np.float32)
118
+
119
+ pred = int(np.argmax(y))
120
+ label = id2label.get(pred, f"class_{pred}")
121
+
122
+ print(f"Top-1 class index: {pred}")
123
+ print(f"Top-1 label: {label}")
124
+ if __name__ == "__main__":
125
+ main()
126
+ ```
127
+ **4. Execute the Python Script**
128
+
129
+ Run the below command:
130
+
131
+ ```bash
132
+ python classify.py --image cat.jpg
133
+ ```
134
+
135
+ ### BibTeX entry and citation info
136
+
137
+ ```bibtex
138
+ @misc{simonyan2015deepconvolutionalnetworkslargescale,
139
+ title={Very Deep Convolutional Networks for Large-Scale Image Recognition},
140
+ author={Karen Simonyan and Andrew Zisserman},
141
+ year={2015},
142
+ eprint={1409.1556},
143
+ archivePrefix={arXiv},
144
+ primaryClass={cs.CV},
145
+ url={https://arxiv.org/abs/1409.1556},
146
+ }
147
+ ```