In this section we demonstrate how to prepare an environment with PyTorch.
MMFlow works on Linux, Windows and macOS. It requires Python 3.6+, CUDA 9.2+ and PyTorch 1.5+.
If you are experienced with PyTorch and have already installed it, just skip this part and jump to the [next section](#installation). Otherwise, you can follow these steps for the preparation.
Step 0. Download and install Miniconda from the official website.
Step 1. Create a conda environment and activate it.
conda create --name openmmlab python=3.8 -y
conda activate openmmlab
Step 2. Install PyTorch following official instructions, e.g.
On GPU platforms:
conda install pytorch torchvision -c pytorch
On CPU platforms:
conda install pytorch torchvision cpuonly -c pytorch
We recommend that users follow our best practices to install MMFlow. However, the whole process is highly customizable. See Customize Installation section for more information.
Step 0. Install MMCV using MIM.
pip install -U openmim
mim install mmcv-full
Step 1. Install MMFlow.
Case a: If you develop and run mmflow directly, install it from source:
git clone https://github.com/open-mmlab/mmflow.git
cd mmflow
pip install -v -e .
# "-v" means verbose, or more output
# "-e" means installing a project in editable mode,
# thus any local modifications made to the code will take effect without reinstallation.
Case b: If you use mmflow as a dependency or third-party package, install it with pip:
pip install mmflow
To verify whether MMFlow is installed correctly, we provide some sample codes to run an inference demo.
Step 1. We need to download config and checkpoint files.
mim download mmflow --config pwcnet_ft_4x1_300k_sintel_final_384x768
The downloading will take several seconds or more, depending on your network environment. When it is done, you will find two files
pwcnet_ft_4x1_300k_sintel_final_384x768.py
and pwcnet_ft_4x1_300k_sintel_final_384x768.pth
in your current folder.
Step 2. Verify the inference demo.
Option (a). If you install mmflow from source, just run the following command.
python demo/image_demo.py demo/frame_0001.png demo/frame_0002.png \
configs/pwcnet/pwcnet_ft_4x1_300k_sintel_final_384x768.py \
checkpoints/pwcnet_ft_4x1_300k_sintel_final_384x768.pth results
Output will be saved in the directory results
including a rendered flow map flow.png
and flow file flow.flo
Option (b). If you install mmflow with pip, open you python interpreter and copy&paste the following codes.
from mmflow.apis import inference_model, init_model
config_file = 'pwcnet_ft_4x1_300k_sintel_final_384x768.py'
checkpoint_file = 'pwcnet_ft_4x1_300k_sintel_final_384x768.pth'
device = 'cuda:0'
# init a model
model = init_model(config_file, checkpoint_file, device=device)
# inference the demo image
inference_model(model, 'demo/frame_0001.png', 'demo/frame_0002.png')
You will see a array printed, which is the flow data.
When installing PyTorch, you need to specify the version of CUDA. If you are not clear on which to choose, follow our recommendations:
- For Ampere-based NVIDIA GPUs, such as GeForce 30 series and NVIDIA A100, CUDA 11 is a must.
- For older NVIDIA GPUs, CUDA 11 is backward compatible, but CUDA 10.2 offers better compatibility and is more lightweight.
Please make sure the GPU driver satisfies the minimum version requirements. See this table for more information.
Installing CUDA runtime libraries is enough if you follow our best practices, because no CUDA code will be compiled locally. However if you hope to compile MMCV from source or develop other CUDA operators, you need to install the complete CUDA toolkit from NVIDIA's [website](https://developer.nvidia.com/cuda-downloads), and its version should match the CUDA version of PyTorch. i.e., the specified version of cudatoolkit in `conda install` command.
MMCV contains C++ and CUDA extensions, thus depending on PyTorch in a complex way. MIM solves such dependencies automatically and makes the installation easier. However, it is not a must.
To install MMCV with pip instead of MIM, please follow MMCV installation guides. This requires manually specifying a find-url based on PyTorch version and its CUDA version.
For example, the following command install mmcv-full built for PyTorch 1.10.x and CUDA 11.3.
pip install mmcv-full -f https://download.openmmlab.com/mmcv/dist/cu113/torch1.10/index.html
MMFlow can be built for CPU only environment. In CPU mode you can train (requires MMCV version >= 1.4.4), test or inference a model.
However some functionalities are gone in this mode:
- Correlation
If you try to train/test/inference a model containing above ops, an error will be raised. The following table lists affected algorithms.
Operator | Model |
---|---|
Correlation | PWC-Net, FlowNetC, FlowNet2, IRR-PWC, LiteFlowNet, LiteFlowNet2, MaskFlowNet |
Google Colab usually has PyTorch installed, thus we only need to install MMCV and MMFlow with the following commands.
Step 1. Install MMCV using MIM.
!pip3 install openmim
!mim install mmcv-full
Step 2. Install MMFlow from the source.
!git clone https://github.com/open-mmlab/mmflow.git
%cd mmflow
!pip install -e .
Step 3. Verification.
import mmflow
print(mmflow.__version__)
# Example output: 0.4.1
Within Jupyter, the exclamation mark `!` is used to call external executables and `%cd` is a [magic command](https://ipython.readthedocs.io/en/stable/interactive/magics.html#magic-cd) to change the current working directory of Python.
We provide a Dockerfile to build an image. Ensure that your docker version >=19.03.
# build an image with PyTorch 1.6, CUDA 10.1
# If you prefer other versions, just modified the Dockerfile
docker build -t mmflow docker/
Run it with
docker run --gpus all --shm-size=8g -it -v {DATA_DIR}:/mmflow/data mmflow
If you have some issues during the installation, please first view the FAQ page. You may open an issue on GitHub if no solution is found.