benchmarks/multi_turn - vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

74452 0 1 Python

	bench_dataset.py	20.7 KB
	bench_utils.py	599 B
	benchmark_serving_multi_turn.py	57.2 KB
	convert_sharegpt_to_openai.py	11.0 KB
	generate_multi_turn.json	799 B
	README.md	6.3 KB
	requirements.txt	88 B