From-scratch impl ofDependencyViT.Official impl not published. Not competitive with sota hierarchical models, advantage over isometric models is lost due to inability to useF.sdpa, but interesting mechanism. Mainly just ViT with a different attn/block, but the cumulative m and topk pruning makes stuff a bit messy. Block exploitsnn.Sequential's untyped intermediate states and feeds tuples through for the cumulative m calculation. I messed around a bit with building dependency trees using the dependency masks, but I have no clue what I'm doing. Currently training weights, have a tiny@72.2% and playing around with a few implementation details and training recipe. Contacted@dingmyu for reference code and weights but no response yet.