Skill
huggingface-accelerate
Wraps existing PyTorch training scripts with HuggingFace Accelerate (Accelerator class, accelerate config, accelerate launch) so the same code runs on CPU, single GPU, multi-GPU, multi-node, TPU, or Apple MPS. Covers device placement, FP16/BF16/FP8 mixed precision, gradient accumulation, distributed checkpointing, and switching between DDP, DeepSpeed ZeRO, FSDP, and Megatron backends. Use when converting a single-GPU script to multi-GPU, enabling mixed precision, configuring DeepSpeed ZeRO or FSDP, or setting up gradient accumulation. Use when one script must run on different hardware. Not for callback-heavy training loops (use PyTorch Lightning) or multi-node orchestration with hyperparameter tuning (use Ray Train).
Bundled with Research Agent Skills. Its trust score, security findings and other files are on the plugin page.
SKILL.md
- Path
- skills/huggingface-accelerate/SKILL.md
- Size
- 11 KB
- SHA-256
- 79763949241db7b83c6a8f11920b1a27f4ede6bc5fc4af695bd772c07a24d3de
Install
Install the plugin's skills with the Skills CLI:
npx [email protected] add KalarisLabs/research-agent-skills