Repository files navigation

AviUtl object tracking (rubbish) plugin based on LKT/optical flow. Use OpenCV 4.9.0 or newer.

*- CPU with AVX support (Not tested on SSE-only CPU)
*- >= 2GB RAM
*- Windows 7 or later
*- AviUtl 1.10
*- Adv.Editing 0.92

Dump the .AUF and MotionTracking_model folder into
your favorite folder where AviUtl loads filter plug-ins

The menu name should be "MotionTracking MK-II Plus"

Additional work is required if Methods 4, 5 or 6 are to be used.

1. Download the following file from the URL listed as a comment out in the source code atthis URL

• dasiamrpn_model.onnx
• dasiamrpn_kernel_r1.onnx
• dasiamrpn_kernel_cls1.onnx

2. Dump each files intoMotionTracking_model folder

1. Download the following file fromthis URL

• nanotrack_backbone_sim.onnx
• nanotrack_head_sim.onnx

2. Dump each files intoMotionTracking_model folder

1. Download the following file fromthis URL

• vitTracker.onnx

2. Dump each files intoMotionTracking_model folder

The single AUF actually contains two more helper plugins:

1. Pre-track: HSV Cvt
2. Pre-track: BGSubtraction

HSVCvt convert the RGB image into HSV, then display it as if RGB. It can also display only one of the HSV channels.

BGSubtraction aims to isolate the moving object from the background. It can output the isolated RGB image, or output a grey-scale mask. Beware that a large Range value may cause out-of-memory problem, or enable Large-Address-Aware to get around.

0. Mark a section to track
1. Click 1st button, Drag a box on the object to be tracked(in popup Window). Close the popup Window.
2. Click Analyze, wait for completion.
3. Activate the View Result and check. IF result is good, check Invert Position if necessary, click SaveEXO or check QuickBlur. Otherwise, click Clear Result and go back to step 0 or 1.

Auto correct for single sandwiched error result.
Support CJK filename

Specifies the algorithm to be used in the analysis.

1. Multi Instance Learning
2. KCF
3. CSRT
4. DaSiamRPN
5. Nano
6. Vit

Specifies the hue of the rectangle displayed in Object Selection and View Result.

• As Sub-filter/部分フィルター？ : Output as a sub filter.
• Invert Position : Reverse the position of the tracking result.
• Ignore Aspect Ratio : Ignore the aspect ratio and output in scale.

“As English EXO?” option has been removed. If you want to load .exo into the English version of AviUtl, please useAviUtl-Exo-Language-Converter orGCMZDrops instead.

• Quick Blur : Direct blur on AviUtl Window according to tracking result.
• Easy Privacy : Blur all detected faces(real face only), No tracking is needed. Works well on frontal face, poor on profile face.

• Range : Use no. of frames before and after current frame for analysis.[30]
• Shadow : 1= Extract shadow [0]

• NMix : Number of Gaussian mixtures [5]
• BG% : Background ratio [70%]

• d2T : Threshold on the squared distance between the pixel and the sample to decide whether a pixel is close to that sample.

1. Rungit clone https://github.com/Mr-Ojii/MotionTracking_MK-II_Plus.git
2. Build your own OpenCV 4.11.0 STATIC (Both Debug and Release builds)
3. Generate VS project file from src/CMakeLists.txt
4. Build with Visual Studio

• GitHub