# QRoPE

This project focuses on quantization techniques for long-context models. The repository includes scripts and tools to perform scale searches per channel for optimizing model performance.


## Installation

1. Clone the repository:
   ```bash
   git clone https://github.com/YeQiao/Long_context_quant.git
   cd Long_context_quant
   
# Project Setup Guide

## Overview
This repository contains scripts and utilities for conducting experiments involving per-channel scaling search for quantization optimization.

## Prerequisites
Ensure that Python is installed (Python 3.8 or higher recommended).

## Installation
First, install the required Python packages:

```bash
pip install -r requirements.txt
```

## Running Experiments
For general usage, take a look scrips under exp_script.

To execute the scaling search experiments, run the provided shell script:

```bash
bash exp_script/scale_search_per_channel.sh
```

## Project Structure

```
.
├── requirements.txt                  # Python package dependencies
└── exp_script                        # Directory containing experiment scripts
    └── scale_search_per_channel.sh   # Main script to execute scaling search experiments
```

## Contact
For issues, suggestions, or contributions, please open an issue or pull request in this repository.

