---
library_name: transformers
tags: []
---

# BERT-Tiny

<!-- Bert-tiny checkpoint from Google's BERT repo. -->

This checkpoint was originally from [Google's BERT repository](https://github.com/google-research/bert), 
and was converted to HuggingFace format by [prajjwal1/bert-tiny](https://huggingface.co/prajjwal1/bert-tiny).

We forces contiguous tensors in the `state_dict` and uploaded here for [MASE]((https://deepwok.github.io/mase/)) and Advanced Deep Learning System Lab.