torch-tensor-parallelism

This skill provides guidance for implementing tensor parallelism in PyTorch, specifically column-parallel and row-parallel linear layers. Use when implementing distributed neural network layers that split weights/activations across multiple ranks, working with torch.distributed for model parallelism, or implementing ColumnParallelLinear and RowParallelLinear classes.

$ Installer

git clone https://github.com/letta-ai/skills /tmp/skills && cp -r /tmp/skills/ai/benchmarks/letta/terminal-bench-2/trajectory-only/torch-tensor-parallelism ~/.claude/skills/skills

// tip: Run this command in your terminal to install the skill