LoRA Parameter Count

Count the trainable parameters of a LoRA adapter of rank r on a layer with in_features inputs and out_features outputs: the matrices $A\in {\mathbb{R}}^{r\times d_{in}}A\backslash in\backslash mathbb\; R^\{r\backslash times\; d\_\{in\}\}$ and $B\in {\mathbb{R}}^{d_{out}\times r}B\backslash in\backslash mathbb\; R^\{d\_\{out\}\backslash times\; r\}$ together.

Implement solve(in_features,out_features,r).

Returns. Return an integer $r(d_{in}+d_{out})r\backslash ,(d\_\{in\}+d\_\{out\})$.

Examples

Example 1

Input:

solve(10, 8, 2)

Output:

36

Example 2

Input:

solve(4096, 4096, 8)

Output:

65536