| | --- |
| | license: apache-2.0 |
| | datasets: |
| | - iamtarun/python_code_instructions_18k_alpaca |
| | language: |
| | - en |
| | pipeline_tag: text-generation |
| | tags: |
| | - code |
| | --- |
| | |
| | # rahuldshetty/tinyllama-python-gguf |
| |
|
| | Quantized GGUF model files for [tinyllama-python](https://huggingface.co/rahuldshetty/tinyllama-python). |
| |
|
| | - Base model: [unsloth/tinyllama-bnb-4bit](https://huggingface.co/unsloth/tinyllama-bnb-4bit) |
| | - Dataset: [iamtarun/python_code_instructions_18k_alpaca](https://huggingface.co/datasets/iamtarun/python_code_instructions_18k_alpaca) |
| | - Training Script: [unslothai: Alpaca + TinyLlama + RoPE Scaling full example.ipynb](https://colab.research.google.com/drive/1AZghoNBQaMDgWJpi4RbffGM1h6raLUj9?usp=sharing) |
| |
|
| | | Name | Quant method | Size | |
| | | ---- | ---- | ---- | |
| | | [tinyllama-python-unsloth.Q2_K.gguf](https://huggingface.co/rahuldshetty/tinyllama-python-gguf/resolve/main/tinyllama-python-unsloth.Q2_K.gguf) | fp16 | 432 MB | |
| |
|
| |
|
| | ## Prompt Format |
| |
|
| | ``` |
| | ### Instruction: |
| | {instruction} |
| | |
| | ### Response: |
| | ``` |
| |
|
| | ## Example |
| |
|
| | ``` |
| | ### Instruction: |
| | Write a function to find cube of a number. |
| | |
| | ### Response: |
| | ``` |
| |
|
| |
|
