Introducing OneSQL-v0.1-Qwen-32B

This model specializes on the Text-to-SQL task. It is finetuned from the quantized version of Qwen2.5-Coder-32B-Instruct. The model has an EX score of 63.33 and R-VES score of 60.02 on the BIRD leaderboard.

Quick Start

To use our model, follow the steps below:

from transformers import AutoModelForCausalLM, AutoTokenizer, pipeline
from peft import PeftModel

model_name = "unsloth/Qwen2.5-Coder-32B-Instruct-bnb-4bit"
adapter_name = "onekq-ai/OneSQL-v0.1-Qwen-32B"
tokenizer = AutoTokenizer.from_pretrained(model_name)
tokenizer.padding_side = "left"

model = PeftModel.from_pretrained(AutoModelForCausalLM.from_pretrained(model_name))

generator = pipeline("text-generation", model=model, tokenizer=tokenizer)

prompt = """
CREATE TABLE students (
    id INTEGER PRIMARY KEY,
    name TEXT,
    age INTEGER,
    grade TEXT
);

-- Find the three youngest students
SELECT """
            

About Us

ONEKQ is an independent research lab focused on AI, benchmarking, and model development.