mwhanna/gemma-scope-attn-saes-16k

This is a re-upload of the GemmaScope attention-out SAEs originally released here. They have been converted to .safetensors format for convenient use with circuit-tracer—this format loads significantly faster, and can easily be offloaded onto disk.

transcoders:

• hf://google/gemma-scope-2b-pt-att/layer_0/width_16k/average_l0_12/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_1/width_16k/average_l0_20/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_2/width_16k/average_l0_19/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_3/width_16k/average_l0_24/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_4/width_16k/average_l0_26/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_5/width_16k/average_l0_30/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_6/width_16k/average_l0_30/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_7/width_16k/average_l0_46/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_8/width_16k/average_l0_32/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_9/width_16k/average_l0_34/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_10/width_16k/average_l0_36/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_11/width_16k/average_l0_41/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_12/width_16k/average_l0_41/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_13/width_16k/average_l0_43/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_14/width_16k/average_l0_37/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_15/width_16k/average_l0_44/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_16/width_16k/average_l0_37/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_17/width_16k/average_l0_38/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_18/width_16k/average_l0_34/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_19/width_16k/average_l0_28/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_20/width_16k/average_l0_31/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_21/width_16k/average_l0_32/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_22/width_16k/average_l0_22/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_23/width_16k/average_l0_30/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_24/width_16k/average_l0_39/params.npz
• hf://google/gemma-scope-2b-pt-att/layer_25/width_16k/average_l0_35/params.npz