Originally reported by @bghira in #1931.

Our LoKr, LoHA, and other LyCORIS modules are outdated and could benefit from your help quite a bit. The following is a list of things that need modifications and fixing:

• fixed rank dropout implementation
• fixed maths (not multiplying against the vector, but only the scalar)
• full matrix tuning
• 1x1 convolutions
• quantised LoHa/LoKr
• weight-decomposed LoHa/LoKr

So, if you are interested, feel free to take one of these up at a time and open PRs. Of course, we will be with you for the PRs, learning from them and provide guidance as needed.

Please mention this issue when opening PRs and tag @BenjaminBossan and myself.