build(deps): bump accelerate from 1.7.0 to 1.10.0

[dependabot]

Bumps accelerate from 1.7.0 to 1.10.0.

Release notes

Sourced from accelerate's releases.

v1.10.0: N-D Parallelism

N-D Parallelism

Training large models across multiple GPUs can be complex, especially when combining different parallelism strategies (e.g TP, CP, DP). To simplify this process, we've collaborated with Axolotl to introduce an easy-to-use integration that allows you to apply any combination of parallelism strategies directly in your training script. Just pass a ParallelismConfig specifying the size of each parallelism type—it's that simple. Learn more about how it works in our latest blogpost.

parallelism_config = ParallelismConfig(
    dp_shard_size=2,
    dp_replicate_size=2,
    cp_size=2,
    tp_size=2,
)
accelerator = Accelerator(
    parallelism_config=parallelism_config,
   ...
)
model = AutoModelForCausalLM.from_pretrained("your-model-name", device_mesh=accelerator.torch_device_mesh)
model = accelerator.prepare(model)

• Parallelism config + TP + HSDP + BYODM (Bring Your Own Device Mesh) by @​SalmanMohammadi in huggingface/accelerate#3682
• Feat: context parallel v2.0 by @​S1ro1 in huggingface/accelerate#3700
• set default submesh_tp_size to prevent unset local variable error by @​winglian in huggingface/accelerate#3687
• Add Parallelism getter property to Accelerator class by @​WoosungMyung in huggingface/accelerate#3703
• Fix: prepare works even if nothing except tp specified (rare) by @​S1ro1 in huggingface/accelerate#3707
• Set parallelism_config in constructor due to Trainer reset of State by @​winglian in huggingface/accelerate#3713
• Fix: tp size wouldn't read from env by @​S1ro1 in huggingface/accelerate#3716
• Remove ParallelismConfig from PartialState by @​SunMarc in huggingface/accelerate#3720

FSDP improvements

We've fixed ignored modules attribute. With this, it is now possible to train PEFT model that moe layers that contrains q_proj and v_proj parameters. This is especially important for fine-tuning gpt-oss model.

• ENH: Allow FSDP ignored modules to be regex by @​BenjaminBossan in huggingface/accelerate#3698
• TST Add test for FSDP ignored_modules as str by @​BenjaminBossan in huggingface/accelerate#3719

Minor improvements

• feature: CpuOffload pre_forward don't attempt to move if already on device by @​JoeGaffney in huggingface/accelerate#3695
• Fix: Ensure environment variable values are case-insensitive in Accelerate by @​jp1924 in huggingface/accelerate#3712
• remove use_ipex by @​SunMarc in huggingface/accelerate#3721

New Contributors

• @​SalmanMohammadi made their first contribution in huggingface/accelerate#3682
• @​WoosungMyung made their first contribution in huggingface/accelerate#3703
• @​jp1924 made their first contribution in huggingface/accelerate#3712
• @​JoeGaffney made their first contribution in huggingface/accelerate#3695

Full Changelog: huggingface/accelerate@v1.9.0...v1.10.0

... (truncated)

Commits

• 5dcd16e Release: v1.10.0
• 2941a6b remove (#3721)
• c0a3aef feature: CpuOffload pre_forward don't attempt to move if already on device (#...
• 42fdda1 Remove ParallelismConfig from PartialState (#3720)
• e23b004 TST Add test for FSDP ignored_modules as str (#3719)
• 898cad3 Fix: tp size wouldn't read from env (#3716)
• 24c8157 Set parallelism_config in constructor due to Trainer reset of State (#3713)
• 6891c57 Feat: context parallel v2.0 (#3700)
• 24e48f3 ENH: Allow FSDP ignored modules to be regex (#3698)
• 6640ff4 Fix: Ensure environment variable values are case-insensitive in Accelerate (#...
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot]

Superseded by #39.