tests/test_infer - hpcaitech/ColossalAI - Morph

SIGN IN SIGN UP

hpcaitech / ColossalAI UNCLAIMED

Making large AI models cheaper, faster and more accessible

41373 0 0 Python

	test_async_engine
	test_kernels
	test_models
	__init__.py
	_utils.py	1.2 KB
	test_batch_bucket.py	5.1 KB
	test_config_and_struct.py	1.2 KB
	test_continuous_batching.py	2.3 KB
	test_cuda_graph.py	2.9 KB
	test_drafter.py	2.5 KB
	test_inference_engine.py	7.2 KB
	test_kvcache_manager.py	6.6 KB
	test_request_handler.py	2.9 KB
	test_rpc_engine.py	4.1 KB
	test_streamingllm.py	3.4 KB