tags: NLP
If you dont have conda installed i recommend going with miniforge . The cool thing about conda is it will take care of installing cuda tools, doing it manually is error prone and annoying
First check what the maximum supported version of cuda is. Type:
nividia-smi and look at the top right corner
Now create a file env.yaml file with the following:
name: axolotl
channels:
- pytorch
- nvidia
- conda-forge
- defaults
dependencies:
- python=3.11
- pytorch
- torchvision
- torchaudio
- pytorch-cuda=12.1
- cuda-nvcc
- pip:
- packaging
- ninja
git clone https://github.com/OpenAccess-AI-Collective/axolotl.git
cd into the repo and install with pip3 install -e '.[flash-attn,deepspeed]'