.infineon/_-Review/private-gpt.md

type, created, updated

type	created	updated
note	2024-03-13T00:32:56.770Z	2024-03-13T03:55:25.945Z

Private GPT

# https://youtu.be/WxYC9-hBM_g?t=1088&si=bvOL8BmNI6KWht5r
# https://github.com/imartinez/privateGPT
# https://docs.privategpt.dev/overview/welcome/introduction
# https://medium.com/@docteur_rs/installing-privategpt-on-wsl-with-gpu-support-5798d763aa31
sudo -i
apt update
apt-get upgrade -y
apt install -y software-properties-common
add-apt-repository ppa:deadsnakes/ppa
[enter]
apt-get remove -y python3
apt autoremove -y
python3 --version
apt-get install -y python3 python3-dev python3-venv python3-pip bluez libffi-dev libssl-dev libjpeg-dev zlib1g-dev autoconf build-essential libopenjp2-7 libturbojpeg0-dev tzdata ffmpeg liblapack3 liblapack-dev libatlas-base-dev
python3 --version
apt-get remove -y python3
apt autoremove -y
python3 --version
apt install -y python3.12 -y
python3 --version
ls /usr/bin/python3*
update-alternatives --install /usr/bin/python3 python3 /usr/bin/python3.12 2
update-alternatives --config python3
[enter]
python3 --version
exit
python3 --version
sudo apt-get install -y build-essential
sudo apt-get install -y git gcc make openssl libssl-dev libbz2-dev libreadline-dev libsqlite3-dev zlib1g-dev libncursesw5-dev libgdbm-dev libc6-dev zlib1g-dev libsqlite3-dev tk-dev libssl-dev openssl libffi-dev
git clone https://github.com/imartinez/privateGPT
curl https://pyenv.run | bash
export PATH="/home/$(whoami)/.pyenv/bin:$PATH"
export PYENV_ROOT="$HOME/.pyenv"
[[ -d $PYENV_ROOT/bin ]] && export PATH="$PYENV_ROOT/bin:$PATH"
eval "$(pyenv init -)"
source .bashrc
sudo apt-get install -y lzma
sudo apt-get install -y liblzma-dev
pyenv install 3.11
pyenv global 3.11
pip install pip --upgrade
pyenv local 3.11
curl -sSL https://install.python-poetry.org | python3 -
export PATH="/home/phares/.local/bin:$PATH"
source ~/.bashrc
poetry --version
cd privateGPT
# poetry install --with ui
# poetry install --with local
# https://stackoverflow.com/questions/78149911/poetry-poetry-install-with-ui-error-groups-not-found-ui-via-with
poetry install --extras ui
poetry install --extras local
exit

wsl --export Ubuntu "Ubuntu\Ubuntu-Private-GPT-001.tar"
wsl --unregister ubuntu

paint "C:\Users\phares\Pictures\Screenshots\Screenshot 2024-03-12 205249.png"
export PATH="/usr/local/cuda-12.3/bin:$PATH"
export LD_LIBRARY_PATH="/usr/local/cuda-12.3/lib64:$LD_LIBRARY_PATH"
ℹ️ Maybe check the content of “/user/local” to be sure that you do have the “cuda-12.3” folder. Yours might have a different version.

Reload your configuration and check that all is working as expected

source ~/.bashrc
nvcc --version
nvidia-smi.exe
ℹ️ “nvidia-smi” isn’t available on WSL so just verify that the .exe one detects your hardware. Both commands should displayed gibberish but no apparent errors.

Building and Running PrivateGPT
Finally, install LLAMA CUDA libraries and Python bindings:

CMAKE_ARGS='-DLLAMA_CUBLAS=on' poetry run pip install --force-reinstall --no-cache-dir llama-cpp-python
poetry run python scripts/setup
make run
make ingest ./dailynotes -- --watch