- Linux with Python ≥ 3.8
- PyTorch ≥ 1.8 and torchvision that matches the PyTorch installation. Install them together at pytorch.org to make sure of this. Note, please check PyTorch version matches that is required by Detectron2.
- PyTorch3d: follow Pytorch3d installation instructions.
- Detectron2: follow Detectron2 installation instructions.
- Segment Anything Model: follow SAM.
Install required packages.
conda create --name ovseg python=3.8
conda activate ovseg
conda install pytorch==1.10.1 torchvision==0.11.2 torchaudio==0.10.1 cudatoolkit=11.3 -c pytorch -c conda-forge
conda install -c fvcore -c iopath -c conda-forge fvcore iopath
conda install pytorch3d -c pytorch3d
pip install -r requirements.txt
You need to download detectron2==0.6
following instructions
python -m pip install detectron2 -f https://dl.fbaipublicfiles.com/detectron2/wheels/cu113/torch1.10/index.html
If you cannot succefully install pycocotools
, try this from here:
conda install -c conda-forge pycocotools
Install the SAM with:
pip install git+https://github.com/facebookresearch/segment-anything.git
To fully support the SAM, install these packages:
pip install opencv-python pycocotools matplotlib onnxruntime onnx
FurtherMore, install the modified clip package.
cd third_party/CLIP
python -m pip install -Ue .