docs/source/en/features - hpcaitech/ColossalAI

Making large AI models cheaper, faster and more accessible

41374 0 0 Python

	1D_tensor_parallel.md	2.4 KB
	2D_tensor_parallel.md	3.0 KB
	2p5D_tensor_parallel.md	2.9 KB
	3D_tensor_parallel.md	3.4 KB
	cluster_utils.md	497 B
	distributed_optimizers.md	6.0 KB
	gradient_accumulation_with_booster.md	7.4 KB
	gradient_clipping_with_booster.md	5.9 KB
	lazy_init.md	2.8 KB
	mixed_precision_training_with_booster.md	10.4 KB
	nvme_offload.md	8.2 KB
	pipeline_parallel.md	9.2 KB
	sequence_parallelism.md	6.9 KB
	shardformer.md	19.4 KB
	zero_with_chunk.md	10.5 KB
	zerobubble_pipeline_parallelism.md	8.1 KB