2024-06-03

_-Review/private-gpt.md

@@ -0,0 +1,92 @@
+---
+type: "note"
+created: "2024-03-13T00:32:56.770Z"
+updated: "2024-03-13T03:55:25.945Z"
+---
+
+# Private GPT
+
+```bash
+# https://youtu.be/WxYC9-hBM_g?t=1088&si=bvOL8BmNI6KWht5r
+# https://github.com/imartinez/privateGPT
+# https://docs.privategpt.dev/overview/welcome/introduction
+# https://medium.com/@docteur_rs/installing-privategpt-on-wsl-with-gpu-support-5798d763aa31
+sudo -i
+apt update
+apt-get upgrade -y
+apt install -y software-properties-common
+add-apt-repository ppa:deadsnakes/ppa
+[enter]
+apt-get remove -y python3
+apt autoremove -y
+python3 --version
+apt-get install -y python3 python3-dev python3-venv python3-pip bluez libffi-dev libssl-dev libjpeg-dev zlib1g-dev autoconf build-essential libopenjp2-7 libturbojpeg0-dev tzdata ffmpeg liblapack3 liblapack-dev libatlas-base-dev
+python3 --version
+apt-get remove -y python3
+apt autoremove -y
+python3 --version
+apt install -y python3.12 -y
+python3 --version
+ls /usr/bin/python3*
+update-alternatives --install /usr/bin/python3 python3 /usr/bin/python3.12 2
+update-alternatives --config python3
+[enter]
+python3 --version
+exit
+python3 --version
+sudo apt-get install -y build-essential
+sudo apt-get install -y git gcc make openssl libssl-dev libbz2-dev libreadline-dev libsqlite3-dev zlib1g-dev libncursesw5-dev libgdbm-dev libc6-dev zlib1g-dev libsqlite3-dev tk-dev libssl-dev openssl libffi-dev
+git clone https://github.com/imartinez/privateGPT
+curl https://pyenv.run | bash
+export PATH="/home/$(whoami)/.pyenv/bin:$PATH"
+export PYENV_ROOT="$HOME/.pyenv"
+[[ -d $PYENV_ROOT/bin ]] && export PATH="$PYENV_ROOT/bin:$PATH"
+eval "$(pyenv init -)"
+source .bashrc
+sudo apt-get install -y lzma
+sudo apt-get install -y liblzma-dev
+pyenv install 3.11
+pyenv global 3.11
+pip install pip --upgrade
+pyenv local 3.11
+curl -sSL https://install.python-poetry.org | python3 -
+export PATH="/home/phares/.local/bin:$PATH"
+source ~/.bashrc
+poetry --version
+cd privateGPT
+# poetry install --with ui
+# poetry install --with local
+# https://stackoverflow.com/questions/78149911/poetry-poetry-install-with-ui-error-groups-not-found-ui-via-with
+poetry install --extras ui
+poetry install --extras local
+exit
+```
+
+```PowerShell
+wsl --export Ubuntu "Ubuntu\Ubuntu-Private-GPT-001.tar"
+wsl --unregister ubuntu
+```
+
+```bash To Do !!!
+paint "C:\Users\phares\Pictures\Screenshots\Screenshot 2024-03-12 205249.png"
+export PATH="/usr/local/cuda-12.3/bin:$PATH"
+export LD_LIBRARY_PATH="/usr/local/cuda-12.3/lib64:$LD_LIBRARY_PATH"
+ℹ️ Maybe check the content of “/user/local” to be sure that you do have the “cuda-12.3” folder. Yours might have a different version.
+
+Reload your configuration and check that all is working as expected
+
+source ~/.bashrc
+nvcc --version
+nvidia-smi.exe
+ℹ️ “nvidia-smi” isn’t available on WSL so just verify that the .exe one detects your hardware. Both commands should displayed gibberish but no apparent errors.
+
+Building and Running PrivateGPT
+Finally, install LLAMA CUDA libraries and Python bindings:
+```
+
+```bash
+CMAKE_ARGS='-DLLAMA_CUBLAS=on' poetry run pip install --force-reinstall --no-cache-dir llama-cpp-python
+poetry run python scripts/setup
+make run
+make ingest ./dailynotes -- --watch
+```