| --- |
| license: apache-2.0 |
| language: |
| - en |
| --- |
| |
| #### This Model |
| This is an intermediate checkpoint with 480K steps and 1007B tokens. |
|
|
|
|
| #### How to use |
| You will need the transformers>=4.31 |
| ```python |
| from transformers import AutoTokenizer |
| import transformers |
| import torch |
| model = "OpenGenerativeAI/testModel" |
| tokenizer = AutoTokenizer.from_pretrained(model) |
| pipeline = transformers.pipeline( |
| "text-generation", |
| model=model, |
| torch_dtype=torch.float16, |
| device_map="auto", |
| ) |
| |
| sequences = pipeline( |
| 'The TinyLlama project aims to pretrain a 1.1B Llama model on 3 trillion tokens. With some proper optimization, we can achieve this within a span of "just" 90 days using 16 A100-40G GPUs 🚀🚀. The training has started on 2023-09-01.', |
| do_sample=True, |
| top_k=10, |
| num_return_sequences=1, |
| repetition_penalty=1.5, |
| eos_token_id=tokenizer.eos_token_id, |
| max_length=500, |
| ) |
| for seq in sequences: |
| print(f"Result: {seq['generated_text']}") |
| ``` |
