Commit f32418c

committed

Update dependencyvit.py

1 parent 3c07131 commit f32418cCopy full SHA for f32418c

File tree

-1

lines changed

-1

lines changed

Lines changed: 1 addition & 1 deletion

Original file line number	Diff line number	Diff line change
`@@ -120,7 +120,7 @@ def forward(self, x: torch.Tensor, m: torch.Tensor) -> Tuple[torch.Tensor, torch`
`120`	`120`	`#prune_mask = attn.sum(1).abs().sum(-1)`
`121`	`121`	`#prune_mask = attn.abs().sum((1, -1))`
`122`	`122`	`#prune_mask = m.reshape(B, N)`
`123`		`- purne_mask = m.detach().reshape(B, N)`
	`123`	`+ prune_mask = m.detach().reshape(B, N)`
`124`	`124`
`125`	`125`	`x = self.proj(x)`
`126`	`126`	`x = self.proj_drop(x)`

Comments

(0)