Instructions to use TokenBender/navarna_dpo_qlora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use TokenBender/navarna_dpo_qlora with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("TokenBender/navaran_hindi_merged") model = PeftModel.from_pretrained(base_model, "TokenBender/navarna_dpo_qlora") - Notebooks
- Google Colab
- Kaggle
Model Card for Model ID
DPO qlora adapter for Navarna, refer to https://huggingface.co/TokenBender/navarna_hindi_merged for SFT qlora merged model.
And final DPO adapter merged model is - https://huggingface.co/TokenBender/navaran_hindi_dpo_merged
- Downloads last month
- 8
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for TokenBender/navarna_dpo_qlora
Base model
TokenBender/navarna_hindi_merged