Compare commits
1 Commits
| Author | SHA1 | Date | |
|---|---|---|---|
| 21efc0a423 |
@@ -26,10 +26,8 @@ We offer both the full version and distilled models. For more information about
|
|||||||
|
|
||||||
## Quick Start
|
## Quick Start
|
||||||
Please make sure you have installed [Flash Attention](https://github.com/Dao-AILab/flash-attention). We recommend CUDA versions 12.4 for the manual installation.
|
Please make sure you have installed [Flash Attention](https://github.com/Dao-AILab/flash-attention). We recommend CUDA versions 12.4 for the manual installation.
|
||||||
|
```
|
||||||
```sh
|
|
||||||
pip install -r requirements.txt
|
pip install -r requirements.txt
|
||||||
pip install -U flash-attn --no-build-isolation
|
|
||||||
```
|
```
|
||||||
|
|
||||||
Then you can run the inference scripts to generate images:
|
Then you can run the inference scripts to generate images:
|
||||||
@@ -44,9 +42,7 @@ python ./inference.py --model_type dev
|
|||||||
# For distilled fast model inference
|
# For distilled fast model inference
|
||||||
python ./inference.py --model_type fast
|
python ./inference.py --model_type fast
|
||||||
```
|
```
|
||||||
|
> **Note:** The inference script will automatically download `meta-llama/Meta-Llama-3.1-8B-Instruct` model files. If you encounter network issues, you can download these files ahead of time and place them in the appropriate cache directory to avoid download failures during inference.
|
||||||
> [!NOTE]
|
|
||||||
> The inference script will try to automatically download `meta-llama/Llama-3.1-8B-Instruct` model files. You need to [agree to the license of the Llama model](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct) on your HuggingFace account and login using `huggingface-cli login` in order to use the automatic downloader.
|
|
||||||
|
|
||||||
## Gradio Demo
|
## Gradio Demo
|
||||||
|
|
||||||
|
|||||||
@@ -3,3 +3,4 @@ torchvision>=0.20.1
|
|||||||
diffusers>=0.32.1
|
diffusers>=0.32.1
|
||||||
transformers>=4.47.1
|
transformers>=4.47.1
|
||||||
einops>=0.7.0
|
einops>=0.7.0
|
||||||
|
accelerate>=1.6.0
|
||||||
|
|||||||
Reference in New Issue
Block a user