Skip to content

[Call for contributions] help us improve LoKr, LoHa, and other LyCORIS  #1935

@sayakpaul

Description

@sayakpaul

Originally reported by @bghira in #1931.

Our LoKr, LoHA, and other LyCORIS modules are outdated and could benefit from your help quite a bit. The following is a list of things that need modifications and fixing:

  • fixed rank dropout implementation
  • fixed maths (not multiplying against the vector, but only the scalar)
  • full matrix tuning
  • 1x1 convolutions
  • quantised LoHa/LoKr
  • weight-decomposed LoHa/LoKr

So, if you are interested, feel free to take one of these up at a time and open PRs. Of course, we will be with you for the PRs, learning from them and provide guidance as needed.

Please mention this issue when opening PRs and tag @BenjaminBossan and myself.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions