Commit Graph

Select branches

Hide Pull Requests

ColossalChat

ckpt_api

cloud/coati

colossalchat

colossalchat_upgrade

dev/gpt2_metainfo_patch

dev/zero-offload

develop

feat/agpo

feat/boxed-version

feat/grpo

feat/hybrid_model_sync

feat/online-serving

feat/ppo

feat/speculative-decoding

feature/2-stage

feature/async-io

feature/colossal-infer

feature/dist-ckp-io

feature/dualpipe

feature/elixir

feature/inference-refactor

feature/lora

feature/ray-rlhf

feature/stable-diffusion

feature/zerobubble

fix-setup

flybird11111-patch-1

grpo-agentic-dev

grpo-code

grpo-dev

grpo-latest

grpo-latest-ascend

grpo-latest-dev

grpo-latest-dev-debug

grpo-latest-dev-reward-update

grpo-latest-rebase-main

grpo-latest-revert

grpo-latest-support-entropy-metric

grpo-latest-v3

grpo-profile

grpo-reward-dev

grpo-support-multi-machine

grpo-zero-bubble

grpo-zero-bubble-rebase

grpo_optimization

hotfix/example_test

hotfix/kernel_build_before_load

hotfix/tp-issue

hpc-ai-cloud

main

moe_sp

pre-commit-ci-update-config

refactor/inference

release/v0.5.0

revert-6292-grpo-latest-dev-reward-update

supercooledith-patch-1

support-npu

upgrade_transformers

uxsqN94oMfWTUNCA

#10

#100

#1000

#1001

#1003

#1004

#1005

#1007

#1008

#1009

#101

#1010

#1011

#1012

#1015

#1016

#1017

#1018

#1019

#1020

#1021

#1022

#1024

#1025

#1026

#1027

#1029

#1030

#1031

#1034

#1040

#1041

#1042

#1044

#1045

#1046

#1047

#1048

#1049

#1050

#1052

#1053

#1054

#1059

#1062

#1063

#1066

#1068

#1069

#1070

#1071

#1072

#1073

#1075

#1076

#1077

#1078

#108

#1080

#1081

#1086

#1087

#1088

#1089

#1090

#1091

#1093

#1094

#1096

#1097

#1098

#1099

#11

#1100

#1101

#1102

#1103

#1105

#1106

#1108

#111

#1115

#1117

#1118

#1119

#112

#1120

#1121

#1122

#1123

#1125

#1127

#1128

#1129

#113

#1130

#1131

#1133

#1134

#1135

#1136

#1137

#1138

#1139

#114

#1140

#1142

#1143

#1144

#1145

#1146

#1147

#1148

#115

#1150

#1151

#1152

#1153

#1154

#1155

#1156

#1157

#1158

#1159

#1160

#1161

#1163

#1164

#1165

#1166

#1167

#1168

#1169

#1170

#1171

#1172

#1173

#1174

#1175

#1176

#1177

#1178

#1179

#118

#1181

#1182

#1185

#1186

#1187

#1188

#1189

#1191

#1192

#1193

#1194

#1196

#1197

#1198

#1199

#12

#1200

#1201

#1202

#1203

#1204

#1207

#1208

#1209

#1210

#1211

#1212

#1213

#1214

#1215

#1216

#1217

#1219

#1220

#1221

#1222

#1223

#1224

#1225

#1226

#1227

#1228

#1229

#123

#1230

#1231

#1232

#1233

#1234

#1235

#1236

#1237

#1238

#1239

#1240

#1241

#1242

#1243

#1244

#1245

#1246

#1247

#1248

#1248

#125

#1250

#1251

#1252

#1253

#1254

#1255

#1256

#1257

#1258

#1259

#126

#1260

#1261

#1262

#1263

#1264

#1265

#1266

#1267

#1268

#1269

#127

#1270

#1271

#1272

#1273

#1274

#1275

#1276

#1277

#1278

#1279

#128

#1280

#1281

#1282

#1283

#1284

#1285

#1286

#1287

#1288

#1288

#1289

#129

#1290

#1291

#1292

#1293

#1294

#1295

#1296

#1297

#1298

#1299

#13

#130

#1300

#1301

#1302

#1303

#1305

#1306

#1307

#1308

#1309

#1310

#1311

#1312

#1313

#1314

#1315

#1316

#1318

#1319

#132

#1320

#1321

#1323

#1324

#1325

#1326

#1327

#1328

#1329

#133

#1331

#1332

#1333

#1334

#1335

#1336

#1338

#1339

#1340

#1342

#1343

#1344

#1345

#1346

#1347

#1348

#1349

#135

#1350

#1351

#1352

#1353

#1354

#1355

#1357

#1358

#1359

#1360

#1361

#1362

#1363

#1364

#1366

#1367

#1368

#1369

#137

#1370

#1372

#1373

#1374

#1376

#1377

#1378

#1379

#138

#1380

#1381

#1382

#1383

#1384

#1385

#1386

#1387

#1388

#1391

#1392

#1393

#1394

#1395

#1396

#1397

#1398

#1399

#14

#140

#1403

#1404

#1405

#1406

#1407

#1408

#1409

#141

#1410

#1415

#1416

#1417

#1418

#1419

#142

#1421

#1422

#1423

#1424

#1425

#1426

#1428

#1429

#143

#1430

#1431

#1432

#1433

#1435

#1436

#1437

#1438

#1439

#144

#1441

#1442

#1444

#1446

#1447

#1448

#1449

#145

#1450

#1451

#1452

#1453

#1456

#1457

#1458

#1459

#146

#1460

#1461

#1462

#1463

#1464

#1465

#1466

#1467

#1468

#1469

#147

#1470

#1471

#1472

#1473

#1475

#1476

#1477

#1478

#1479

#148

#1480

#1481

#1482

#1483

#1484

#1486

#1487

#1488

#1489

#1490

#1492

#1493

#1494

#1495

#1496

#1497

#1499

#15

#1500

#1501

#1502

#1503

#1504

#1505

#1506

#1507

#1508

#1509

#151

#1510

#1511

#1512

#1513

#1514

#1515

#1516

#1518

#1519

#152

#1520

#1521

#1522

#1523

#1524

#1525

#1526

#1527

#1528

#1529

#153

#1530

#1531

#1532

#1533

#1534

#1535

#1536

#1537

#1538

#1539

#154

#1541

#1542

#1543

#1544

#1545

#1546

#1547

#1548

#1549

#1550

#1551

#1552

#1553

#1554

#1555

#1556

#1557

#1558

#1559

#156

#1560

#1561

#1562

#1563

#1564

#1565

#1566

#1567

#1568

#1569

#157

#1570

#1571

#1572

#1573

#1574

#1575

#1576

#1578

#1581

#1583

#1584

#1585

#1586

#1587

#1588

#1589

#159

#1590

#1591

#1594

#1595

#1596

#1597

#1598

#1599

#160

#1600

#1601

#1602

#1603

#1604

#1605

#1606

#1607

#1608

#1609

#161

#1610

#1611

#1612

#1613

#1614

#1615

#1616

#1617

#1618

#1619

#162

#1620

#1621

#1622

#1623

#1624

#1625

#1628

#1629

#163

#1630

#1631

#1633

#1634

#1635

#1636

#1637

#1638

#1639

#164

#1640

#1641

#1642

#1643

#1644

#1645

#1646

#1647

#1648

#1649

#165

#1650

#1651

#1652

#1653

#1654

#1655

#1656

#1657

#1658

#1659

#166

#1660

#1661

#1662

#1663

#1664

#1665

#1666

#1667

#1669

#167

#1670

#1671

#1673

#1674

#1676

#1677

#1678

#1679

#168

#1680

#1681

#1682

#1683

#1684

#1686

#1687

#1688

#1689

#1690

#1691

#1692

#1694

#1695

#1696

#1697

#1698

#1699

#17

#1700

#1701

#1702

#1703

#1704

#1705

#1706

#1707

#1708

#1709

#171

#1710

#1711

#1712

#1713

#1714

#1715

#1716

#1717

#1718

#1719

#172

#1720

#1721

#1722

#1723

#1724

#1725

#1726

#1727

#1728

#1729

#173

#1730

#1731

#1732

#1733

#1734

#1735

#1736

#1739

#174

#1740

#1741

#1742

#1743

#1744

#1745

#1746

#1747

#1748

#1750

#1751

#1752

#1753

#1754

#1755

#1757

#1758

#1759

#176

#1760

#1762

#1763

#1764

#1765

#1766

#1767

#1768

#1769

#1770

#1771

#1772

#1775

#1776

#1778

#178

#1780

#1781

#1782

#1783

#1784

#1785

#1786

#1787

#1788

#1789

#179

#1790

#1791

#1792

#1793

#1796

#1797

#1798

#1799

#18

#1800

#1801

#1802

#1803

#1804

#1805

#1806

#1807

#1808

#1809

#1810

#1811

#1812

#1813

#1814

#1815

#1816

#1817

#1818

#1819

#1820

#1821

#1822

#1823

#1824

#1825

#1826

#1827

#1828

#1829

#183

#1830

#1831

#1832

#1833

#1834

#1835

#1836

#1837

#184

#1840

#1842

#1843

#1844

#1845

#1846

#1847

#1848

#1849

#1851

#1852

#1853

#1854

#1855

#1856

#1857

#1858

#1859

#186

#1860

#1865

#1866

#1867

#1868

#1869

#187

#1871

#1873

#1874

#1875

#1876

#1877

#1878

#1879

#188

#1880

#1889

#189

#1891

#1893

#1894

#1895

#1896

#1897

#1898

#1899

#19

#190

#1901

#1902

#1903

#1904

#1905

#1906

#1907

#1908

#1909

#191

#1910

#1916

#1917

#1918

#1919

#192

#1920

#1921

#1922

#1924

#1925

#1927

#1928

#193

#1930

#1931

#1937

#1938

#1939

#194

#1940

#1941

#1942

#1943

#1944

#1946

#1950

#1950

#1952

#1953

#1954

#1955

#1957

#1958

#1959

#196

#1960

#1961

#1962

#1963

#1964

#1967

#1968

#197

#1970

#1971

#1972

#1973

#1974

#1977

#1978

#1979

#198

#1980

#1981

#1982

#1984

#1985

#1986

#1987

#1989

#1990

#1998

#1999

#2

#20

#200

#2000

#2001

#2002

#2003

#2004

#2005

#2006

#2007

#2008

#2009

#201

#2010

#2011

#2015

#2016

#2017

#2018

#2019

#202

#2020

#2021

#2021

#2022

#2023

#2025

#2027

#2028

#2029

#203

#2030

#2032

#2033

#2034

#2035

#2036

#2037

#2038

#2039

#204

#2040

#2042

#2043

#2045

#2046

#2047

#2048

#205

#2050

#2051

#2052

#2053

#2058

#2059

#2060

#2061

#2062

#2064

#2065

#2066

#2069

#2071

#2072

#2073

#2074

#2075

#2076

#2077

#2078

#2079

#2080

#2081

#2082

#2083

#2084

#2085

#2086

#2087

#2088

#2089

#209

#2090

#2091

#2092

#2095

#2096

#2097

#2098

#2099

#21

#210

#2101

#2102

#2103

#2104

#2105

#2106

#2107

#2108

#2110

#2111

#2112

#2113

#2115

#2116

#2117

#2118

#2119

#212

#2120

#2123

#2124

#2125

#2126

#2127

#2128

#2129

#213

#2130

#2131

#2132

#2133

#2134

#2136

#2137

#2138

#2139

#214

#2144

#2146

#2147

#2148

#2149

#215

#2150

#2151

#2152

#2153

#2154

#2155

#2156

#2157

#2158

#2159

#2162

#2163

#2164

#2165

#2167

#2168

#2168

#2169

#217

#2171

#2172

#2173

#2174

#2175

#2177

#2178

#2179

#218

#2184

#2186

#2187

#2188

#2189

#219

#2190

#2191

#2193

#2194

#2195

#2196

#2197

#220

#2200

#2201

#2202

#2203

#2206

#2207

#2208

#2209

#221

#2210

#2211

#2212

#2213

#2214

#2216

#2217

#2219

#222

#2221

#2222

#2223

#2224

#2225

#2226

#2227

#2228

#2229

#223

#2231

#2232

#2234

#2237

#2238

#2239

#224

#2242

#2243

#2244

#2245

#2247

#2248

#2254

#2257

#2258

#226

#2261

#2262

#2263

#2264

#2265

#2266

#2267

#2268

#2268

#2269

#227

#2270

#2271

#2272

#2273

#2274

#2275

#2276

#2277

#2278

#2279

#2280

#2281

#2282

#2283

#2284

#2286

#2287

#2288

#2289

#229

#2290

#2291

#2292

#2293

#2295

#2296

#2297

#2298

#2299

#23

#2300

#2301

#2302

#2303

#2304

#2305

#2306

#2307

#2308

#2310

#2311

#2312

#2313

#2314

#2315

#2316

#2317

#2318

#2319

#232

#2320

#2322

#2323

#2326

#2327

#2328

#2329

#233

#2333

#2336

#2338

#2339

#2340

#2342

#2344

#2345

#2348

#2349

#2350

#2352

#2353

#2354

#2355

#2356

#2357

#2358

#2359

#2363

#2364

#2365

#2366

#2367

#2368

#2370

#2371

#2372

#2373

#2374

#2375

#2379

#2381

#2385

#2387

#2389

#2390

#2393

#2395

#2396

#2396

#2397

#2399

#24

#240

#2400

#2401

#2403

#2404

#2405

#2406

#2408

#2410

#2411

#2412

#2413

#2414

#2415

#2416

#2417

#2418

#2419

#242

#2420

#2423

#2424

#2427

#243

#2431

#2432

#2434

#2436

#2438

#244

#2442

#2443

#2444

#2445

#2446

#2448

#2449

#245

#2451

#2452

#2453

#2456

#2459

#246

#2463

#2464

#2465

#2466

#2468

#2469

#2471

#2473

#2474

#2475

#2476

#2477

#248

#2481

#2482

#2483

#2484

#2485

#2486

#2488

#249

#2492

#2494

#2495

#2497

#2498

#2499

#25

#2502

#2503

#2504

#2506

#2507

#2508

#2509

#251

#2510

#2511

#2512

#2514

#2515

#2516

#2517

#2518

#2519

#252

#2520

#2521

#2522

#2523

#2524

#2525

#2526

#2527

#2528

#2529

#253

#2532

#2533

#2534

#2537

#2538

#2540

#2543

#2544

#2545

#2549

#255

#2550

#2552

#2554

#2556

#2558

#2560

#2561

#2564

#2565

#2567

#2568

#2572

#2574

#2577

#2578

#2581

#2584

#2585

#2586

#2589

#2591

#2594

#2596

#2598

#2600

#2601

#2602

#2604

#2607

#2608

#2611

#2613

#2614

#2615

#2618

#2619

#2621

#2623

#2624

#2625

#2626

#263

#2635

#2637

#264

#2641

#2643

#2644

#2647

#2648

#265

#2652

#2656

#2657

#2658

#2659

#266

#2661

#2664

#2665

#2666

#2669

#267

#2670

#2671

#2672

#2674

#2675

#2678

#268

#2680

#2681

#2683

#2686

#2687

#2689

#2689

#269

#2690

#2691

#2692

#2693

#2694

#2695

#2696

#2698

#2699

#27

#270

#2700

#2701

#2701

#2702

#2702

#2703

#2704

#2705

#2706

#2707

#2708

#2709

#271

#2711

#2712

#2713

#2714

#2715

#2716

#2717

#2719

#272

#2720

#2721

#2723

#2725

#2726

#2727

#2728

#273

#2730

#2734

#2736

#2737

#2738

#274

#2740

#2741

#2742

#2744

#2747

#2749

#2749

#275

#2754

#276

#2760

#2762

#2764

#2766

#2767

#2769

#277

#2773

#2775

#2777

#2789

#279

#2791

#2792

#2796

#2797

#2798

#28

#280

#2803

#2804

#281

#2812

#2813

#2817

#282

#2820

#2821

#2822

#2823

#2824

#2826

#2829

#283

#2835

#2837

#284

#2846

#2848

#2849

#285

#2852

#2854

#286

#2860

#2863

#2867

#2869

#287

#2871

#2876

#288

#2880

#2886

#2895

#29

#291

#2912

#2914

#292

#2920

#2922

#2923

#2925

#2927

#2929

#293

#2930

#2932

#2933

#2935

#2939

#294

#2944

#2946

#2951

#2954

#296

#2964

#2966

#2969

#297

#2971

#2974

#2977

#298

#2982

#2983

#2984

#2986

#2987

#2988

#299

#2993

#2994

#2996

#2997

#2999

#3

#30

#300

#3006

#3008

#301

#3014

#3017

#3019

#302

#3020

#3022

#3025

#3026

#3028

#3029

#303

#3032

#3034

#3037

#304

#3042

#305

#3055

#3056

#3057

#3058

#306

#3062

#3065

#307

#3070

#3072

#3073

#3075

#3079

#308

#3080

#3082

#3084

#3085

#3086

#3087

#3089

#309

#3093

#3094

#3098

#3099

#310

#3101

#3104

#3105

#3107

#3108

#311

#3113

#3116

#312

#3121

#3122

#3128

#3129

#313

#3131

#3132

#3133

#3135

#3136

#3138

#3139

#3147

#315

#3151

#3153

#3154

#3157

#3159

#316

#3162

#3166

#3167

#317

#3170

#3173

#3174

#3177

#3178

#3180

#3181

#3183

#3185

#3186

#3188

#3190

#3191

#3194

#3195

#3197

#3199

#32

#320

#3204

#3205

#3206

#3207

#3209

#321

#3211

#3213

#3216

#3218

#3219

#322

#3221

#3222

#3223

#3225

#3227

#3229

#323

#3230

#3232

#3233

#3236

#3238

#3239

#324

#3241

#3244

#325

#3253

#3254

#3255

#3256

#3257

#3259

#3260

#3261

#3262

#3263

#3265

#3266

#3268

#3269

#327

#3270

#3272

#3273

#3274

#3275

#3276

#3277

#3279

#328

#3282

#3283

#3284

#3285

#3286

#3287

#3288

#3289

#329

#3290

#3292

#3293

#3294

#3295

#3296

#3297

#3298

#3299

#33

#330

#3300

#3301

#3302

#3304

#3305

#3306

#3307

#3308

#3309

#331

#3311

#3312

#3313

#3315

#3318

#332

#3323

#3327

#3329

#333

#3332

#3333

#3338

#334

#3343

#3346

#3347

#335

#3352

#3354

#336

#3367

#3368

#337

#3377

#3378

#3379

#338

#3384

#3386

#339

#3398

#34

#340

#3405

#3408

#341

#3411

#3417

#3418

#342

#3420

#3424

#3427

#3429

#343

#3431

#3433

#3436

#344

#3442

#3445

#3448

#345

#3450

#3452

#3453

#346

#3461

#3465

#347

#3472

#3473

#3474

#3475

#3476

#3477

#3479

#348

#3481

#3486

#3488

#349

#3493

#3497

#35

#350

#3504

#3506

#351

#3513

#3516

#3517

#3519

#352

#3520

#3522

#3525

#353

#3536

#354

#3541

#3548

#3549

#355

#3551

#3552

#3553

#3557

#356

#3561

#3563

#3567

#3567

#3568

#357

#3572

#3573

#3577

#3578

#3579

#358

#3581

#3586

#3588

#3589

#359

#3590

#3592

#3593

#3594

#3596

#3597

#36

#360

#3603

#3605

#3608

#361

#3610

#3611

#3612

#3618

#3619

#362

#3621

#3623

#3625

#3627

#3628

#363

#3632

#364

#3641

#3645

#3646

#3647

#3648

#365

#3652

#3653

#3654

#3655

#3656

#366

#3662

#3663

#3666

#3667

#3668

#367

#3671

#3679

#368

#3680

#3684

#3688

#369

#3691

#3692

#3693

#3694

#3695

#3697

#3699

#3699

#370

#3706

#3707

#3709

#371

#3710

#3711

#3713

#3715

#3718

#3719

#372

#3722

#3725

#3727

#3728

#3729

#373

#3730

#3731

#3735

#374

#3740

#3742

#3744

#3748

#375

#3751

#3754

#3756

#3758

#3759

#376

#3763

#3765

#3767

#377

#3770

#3771

#3772

#3774

#3775

#3778

#3779

#378

#3780

#3781

#3782

#3783

#3785

#3786

#3787

#3788

#3789

#379

#3792

#3794

#3795

#3799

#38

#380

#3801

#3804

#3805

#3806

#3807

#3808

#3809

#381

#3810

#3813

#3815

#3816

#3817

#382

#3820

#3821

#3822

#3823

#3824

#3825

#3826

#3827

#3828

#3829

#383

#3830

#3831

#3833

#3834

#3835

#3838

#384

#3841

#3842

#3844

#3845

#3846

#3847

#3849

#385

#3850

#3855

#3856

#386

#3860

#3862

#3864

#3865

#3868

#3869

#387

#3871

#3872

#3873

#3877

#3878

#3879

#388

#3880

#3882

#3883

#3884

#3885

#3887

#389

#3890

#3891

#3896

#3898

#3899

#39

#390

#3900

#3901

#3902

#3905

#3907

#3908

#3909

#391

#3910

#3911

#3913

#3915

#3916

#3917

#3918

#3919

#392

#3920

#3922

#3923

#3924

#3925

#3926

#3928

#3929

#393

#3930

#3931

#3932

#3934

#3936

#3937

#3939

#394

#3940

#3942

#3943

#3944

#3946

#3947

#3949

#395

#3956

#3960

#3963

#3967

#3968

#3969

#397

#3970

#3972

#3976

#3976

#3979

#3980

#3984

#3985

#3987

#3988

#399

#3990

#3991

#3993

#3994

#3996

#3999

#4

#40

#400

#4001

#4002

#4004

#4006

#4006

#401

#4011

#4013

#4014

#4016

#4018

#4019

#402

#4020

#4021

#4022

#4024

#4025

#4026

#4028

#403

#4030

#4033

#4034

#4036

#4039

#404

#4041

#4043

#4045

#4046

#4046

#4047

#4048

#4049

#4053

#4055

#4056

#4058

#406

#4060

#4062

#4064

#4065

#4067

#4068

#4068

#4069

#407

#4070

#4072

#4073

#4075

#4079

#4080

#4081

#4082

#4083

#4086

#4087

#4089

#409

#4090

#4091

#4093

#4094

#4096

#4098

#41

#410

#4100

#4101

#4103

#4105

#4106

#4107

#4109

#411

#4111

#4112

#4115

#4117

#412

#4122

#4124

#4126

#4127

#4129

#413

#4130

#4132

#4137

#4138

#4139

#414

#4141

#4142

#4144

#4145

#4146

#4147

#4149

#4152

#4153

#4155

#4157

#4158

#4159

#416

#4160

#4161

#4162

#4163

#4165

#4166

#4167

#4169

#417

#4171

#4172

#4173

#4174

#4175

#4176

#4178

#4179

#418

#4180

#4182

#4185

#4187

#4188

#419

#4191

#4192

#4194

#4196

#4197

#42

#420

#4202

#4203

#4205

#4206

#4208

#421

#4210

#4212

#4213

#4214

#4215

#4216

#4217

#4218

#422

#4221

#4223

#4224

#4225

#4226

#4227

#4228

#4229

#423

#423

#4231

#4233

#4234

#4236

#4237

#4238

#4239

#424

#4240

#4241

#4243

#4244

#4245

#4246

#4248

#4250

#4251

#4252

#4253

#4254

#4255

#4256

#4257

#4258

#4259

#426

#4260

#4261

#4263

#4264

#4265

#4266

#4267

#4268

#4269

#427

#4270

#4271

#4272

#4273

#4274

#4275

#4276

#4277

#4278

#4279

#428

#4283

#4284

#4287

#4288

#429

#4290

#4291

#4293

#4295

#4297

#4299

#43

#430

#4300

#4301

#4302

#4303

#4305

#4306

#4307

#4309

#4309

#431

#4310

#4312

#4313

#4314

#4315

#4316

#4317

#432

#4320

#4321

#4323

#4324

#4325

#4329

#433

#4330

#4331

#4332

#4333

#4334

#4336

#4338

#434

#4340

#4341

#4345

#4346

#4347

#4349

#435

#4350

#4352

#4354

#4355

#4356

#4357

#4358

#4359

#436

#4362

#4363

#4366

#4369

#4372

#4377

#4379

#438

#4380

#4382

#4384

#4386

#4388

#4389

#439

#4392

#4395

#4396

#4398

#4399

#44

#440

#4401

#4403

#4404

#4405

#4407

#4408

#4409

#441

#4413

#4415

#4416

#442

#4420

#4421

#4423

#4424

#4426

#4426

#4428

#4429

#4430

#4431

#4432

#4433

#4434

#4435

#4436

#4440

#4441

#4443

#4445

#4446

#4448

#445

#4450

#4452

#4455

#4456

#4457

#4458

#446

#4460

#4461

#4462

#4463

#4465

#4466

#4468

#4469

#447

#4471

#4472

#4473

#4479

#448

#4480

#4481

#4482

#4484

#4485

#4488

#449

#4492

#4493

#4494

#4495

#4496

#4497

#4498

#4499

#45

#450

#4501

#4502

#4503

#4504

#4505

#4506

#4507

#4508

#4509

#451

#4511

#4512

#4514

#4516

#4517

#4519

#452

#4520

#4521

#4523

#4524

#4526

#4527

#4529

#453

#4531

#4532

#4533

#4535

#4536

#4538

#4539

#454

#4540

#4541

#4542

#4544

#4545

#4546

#4549

#455

#4550

#4552

#4553

#4554

#4555

#4556

#4557

#4558

#4559

#456

#4560

#4561

#4563

#4564

#4566

#4569

#457

#4570

#4571

#4572

#4574

#4575

#4576

#4577

#4579

#458

#4580

#4581

#4584

#4585

#4586

#4587

#4588

#4589

#459

#4591

#4592

#4593

#4593

#4595

#4597

#4598

#4599

#46

#460

#4600

#4601

#4602

#4603

#4604

#4606

#4608

#4609

#461

#4611

#4612

#4614

#4615

#4616

#4617

#4618

#4619

#462

#4620

#4621

#4622

#4623

#4624

#4627

#4629

#463

#4630

#4631

#4632

#4633

#4634

#4635

#4636

#4637

#464

#4640

#4641

#4642

#4645

#4646

#4647

#465

#4650

#4653

#4654

#4655

#4656

#4657

#4658

#4659

#4659

#4663

#4665

#4666

#4667

#4669

#467

#4670

#4671

#4672

#4673

#4674

#4676

#4678

#4680

#4683

#4684

#4685

#4686

#4689

#469

#4690

#4692

#4693

#4694

#4695

#4696

#4697

#4698

#4699

#47

#470

#4700

#4701

#4702

#4703

#4704

#4706

#4707

#4708

#4709

#471

#4710

#4712

#4713

#4715

#4716

#4718

#472

#4720

#4721

#4722

#4723

#4724

#4725

#4726

#4727

#4728

#4729

#473

#4730

#4731

#4732

#4733

#4734

#4735

#4736

#4738

#474

#4740

#4741

#4742

#4743

#4745

#4748

#4749

#475

#4750

#4752

#4753

#4754

#4755

#4757

#4758

#476

#4763

#4764

#4765

#4766

#4768

#477

#4770

#4771

#4772

#4773

#4774

#4775

#4777

#4778

#4779

#478

#4784

#4786

#4787

#4788

#4789

#479

#4790

#4791

#4792

#4793

#4794

#4795

#4796

#4798

#4799

#48

#480

#4800

#4801

#4802

#4804

#4805

#4807

#4808

#4809

#481

#4810

#4811

#4812

#4813

#4814

#4815

#4816

#4817

#4819

#482

#4820

#4821

#4822

#4823

#4824

#4825

#4827

#4828

#483

#4830

#4831

#4832

#4834

#4836

#4837

#4838

#484

#4840

#4841

#4842

#4843

#4846

#4849

#4849

#485

#4850

#4851

#4852

#4853

#4854

#4856

#4858

#486

#4860

#4861

#4864

#4866

#4869

#487

#4872

#4873

#4874

#4876

#4877

#4878

#488

#4883

#4884

#4886

#4887

#4889

#489

#4890

#4893

#4894

#4895

#4896

#4897

#4898

#49

#490

#4900

#4901

#4902

#4904

#4905

#4907

#4908

#4909

#491

#4910

#4911

#4914

#4915

#4916

#4917

#4918

#4919

#492

#4920

#4921

#4922

#4923

#4925

#4926

#4927

#4928

#493

#4932

#4933

#4934

#4935

#4936

#4937

#4938

#4940

#4942

#4943

#4945

#4946

#4947

#4948

#4949

#495

#4950

#4951

#4952

#4953

#4954

#4959

#496

#4963

#4965

#4966

#4967

#497

#4972

#4975

#4976

#4976

#4977

#4978

#498

#4981

#4982

#4983

#4988

#4989

#4990

#4991

#4992

#4993

#4995

#4996

#4998

#5

#50

#500

#5001

#5002

#5007

#5008

#5009

#501

#5012

#5014

#5015

#5017

#5018

#502

#5020

#5022

#5023

#5024

#5025

#503

#5031

#5032

#5033

#5035

#5036

#504

#5043

#5044

#5046

#5047

#5048

#505

#5051

#5052

#5053

#5055

#5057

#5058

#5059

#506

#5060

#5062

#5063

#5064

#5065

#5067

#5069

#507

#5070

#5071

#5072

#5073

#5074

#5076

#5077

#5078

#5079

#508

#5080

#5081

#5082

#5082

#5084

#5085

#5086

#5087

#5088

#5089

#509

#5090

#5092

#5093

#5095

#5096

#5097

#5098

#5099

#51

#510

#5100

#5102

#5103

#5105

#5106

#5107

#511

#5111

#5112

#5113

#5114

#5115

#5116

#5117

#5118

#512

#5120

#5120

#5121

#5122

#5123

#5124

#5125

#5127

#5128

#5129

#513

#5130

#5131

#5132

#5133

#5134

#5135

#5138

#514

#5140

#5141

#5143

#5146

#5147

#5148

#5149

#515

#5150

#5153

#5155

#5155

#5156

#5157

#5158

#5159

#516

#5160

#5160

#5161

#5162

#5164

#5165

#5166

#5169

#517

#5170

#5171

#5172

#5173

#5176

#5177

#5178

#518

#5181

#5183

#5186

#5189

#519

#5190

#5192

#5194

#5196

#5199

#52

#520

#5201

#5202

#5206

#5207

#5209

#521

#5210

#5214

#5216

#5217

#5219

#522

#5224

#5225

#5227

#5228

#5229

#5230

#5231

#5232

#5233

#5234

#5235

#5236

#5237

#5238

#5239

#5240

#5241

#5242

#5246

#5247

#5248

#5248

#5249

#525

#5250

#5251

#5252

#5253

#5254

#5255

#5256

#5257

#5258

#5258

#526

#5260

#5261

#5262

#5263

#5264

#5265

#5265

#5267

#5267

#5268

#5269

#527

#5270

#5272

#5273

#5274

#5275

#5276

#5277

#5278

#5279

#528

#5280

#5281

#5282

#5283

#5284

#5285

#5286

#5287

#5288

#5289

#529

#5291

#5292

#5294

#5294

#5295

#5296

#5297

#5298

#5299

#53

#530

#5301

#5302

#5303

#5304

#5306

#5307

#5308

#5309

#531

#5310

#5311

#5313

#5314

#5315

#5316

#5317

#5318

#532

#5320

#5321

#5322

#5324

#5325

#5326

#5327

#5329

#533

#5330

#5331

#5332

#5333

#5334

#5335

#5336

#5337

#5338

#5339

#5340

#5341

#5342

#5343

#5344

#5345

#5346

#5347

#5348

#5349

#535

#5350

#5351

#5352

#5353

#5354

#5355

#5356

#5357

#5358

#536

#5360

#5361

#5362

#5363

#5364

#5365

#5366

#5367

#5368

#5369

#537

#5371

#5372

#5373

#5374

#5375

#5376

#5377

#5378

#5379

#538

#5380

#5382

#5383

#5384

#5386

#5388

#5389

#539

#5390

#5392

#5395

#5396

#5398

#5399

#54

#540

#5400

#5401

#5402

#5403

#5404

#5405

#5406

#5407

#5408

#541

#5411

#5412

#5413

#5415

#5416

#5417

#5418

#542

#5420

#5422

#5423

#5424

#5425

#5427

#5428

#5429

#543

#5430

#5431

#5432

#5433

#5434

#5435

#5437

#5438

#5440

#5441

#5442

#5444

#5445

#5446

#5447

#5448

#5449

#545

#5451

#5452

#5454

#5455

#5456

#5457

#546

#5460

#5461

#5462

#5465

#5468

#5469

#547

#5470

#5471

#5472

#5473

#5476

#5477

#5477

#5479

#548

#5480

#5484

#5485

#5486

#5486

#5489

#549

#5490

#5491

#5493

#5493

#5495

#5496

#5497

#5498

#5499

#55

#5500

#5501

#5502

#5503

#5504

#5506

#5508

#551

#5510

#5511

#5512

#5514

#5515

#5517

#5518

#5519

#552

#5520

#5522

#5523

#5524

#5525

#5526

#5528

#5529

#553

#5530

#5531

#5532

#5533

#5535

#5537

#554

#5541

#5543

#5544

#5545

#5546

#5548

#555

#5550

#5551

#5552

#5554

#5556

#5557

#5558

#5559

#556

#5561

#5563

#5565

#5566

#5567

#5568

#5569

#5570

#5572

#5574

#5575

#5576

#5577

#5578

#5579

#558

#5580

#5581

#5582

#5583

#5584

#5586

#5588

#5589

#559

#5590

#5591

#5592

#5593

#5596

#5598

#5599

#5602

#5603

#5604

#5605

#5606

#5607

#5608

#5609

#561

#5610

#5611

#5612

#5613

#5614

#5619

#5620

#5621

#5622

#5623

#5624

#5625

#5626

#5627

#5628

#5629

#563

#5630

#5631

#5632

#5633

#5634

#5635

#5636

#5637

#5638

#5639

#564

#5640

#5642

#5643

#5644

#5645

#5646

#5647

#5648

#5649

#565

#5650

#5651

#5652

#5653

#5654

#5655

#5656

#5657

#5658

#5659

#566

#5660

#5660

#5661

#5663

#5665

#5666

#5668

#5668

#567

#5670

#5674

#5675

#5676

#5677

#5678

#5679

#568

#5680

#5681

#5682

#5684

#5685

#5686

#5687

#5688

#5689

#569

#5690

#5691

#5692

#5693

#5694

#5695

#5696

#5697

#5698

#5699

#57

#570

#5700

#5701

#5702

#5703

#5704

#5705

#5706

#5707

#5708

#571

#5710

#5711

#5712

#5713

#5714

#5715

#5715

#5716

#5717

#5719

#572

#5720

#5722

#5723

#5724

#5725

#5727

#573

#5730

#5731

#5733

#5734

#5735

#5736

#5737

#5738

#5739

#574

#5740

#5741

#5742

#5743

#5744

#5745

#5746

#5747

#5748

#5749

#575

#5750

#5751

#5752

#5753

#5754

#5755

#5756

#5756

#5758

#5759

#576

#5760

#5761

#5763

#5764

#5765

#5766

#5767

#5769

#577

#5770

#5771

#5772

#5774

#5775

#5776

#5777

#5779

#578

#5780

#5781

#5782

#5783

#5784

#5785

#5786

#5787

#5788

#5789

#579

#5790

#5791

#5793

#5794

#5796

#5797

#5799

#58

#580

#5800

#5801

#5802

#5803

#5804

#5806

#5807

#5808

#5809

#581

#5810

#5811

#5812

#5813

#5814

#5815

#5816

#5817

#5818

#5819

#582

#5820

#5821

#5822

#5823

#5824

#5825

#5827

#5828

#5829

#583

#5832

#5833

#5835

#5836

#5837

#5838

#5839

#584

#5840

#5842

#5843

#5844

#5845

#5846

#5847

#5848

#5849

#585

#5850

#5851

#5852

#5854

#5856

#5857

#5858

#5859

#586

#5860

#5862

#5863

#5864

#5867

#5868

#5870

#5871

#5872

#5874

#5875

#5876

#5877

#5877

#5878

#5879

#5881

#5882

#5883

#5884

#5885

#5888

#5889

#589

#5891

#5892

#5893

#5894

#5895

#5896

#5897

#5898

#5899

#59

#590

#5901

#5902

#5903

#5904

#5905

#591

#5910

#5911

#5912

#5917

#5918

#5919

#592

#5921

#5922

#5923

#5924

#5925

#5928

#593

#5931

#5932

#5934

#5936

#5938

#5939

#5939

#594

#5941

#5942

#5944

#5945

#5946

#5947

#595

#5950

#5951

#5952

#5953

#5956

#5957

#5958

#5959

#596

#5961

#5962

#5963

#5966

#5967

#5968

#597

#5970

#5973

#5975

#5976

#5977

#5978

#5979

#598

#5980

#5981

#5982

#5984

#5985

#5989

#599

#5990

#5991

#5993

#5994

#5995

#5997

#5998

#6

#60

#6000

#6001

#6002

#6003

#6004

#6005

#6006

#6007

#6008

#6009

#601

#6010

#6011

#6012

#6013

#6014

#6015

#6015

#6016

#6017

#6018

#6020

#6022

#6023

#6024

#6026

#6029

#603

#6030

#6031

#6033

#6034

#6035

#6036

#6038

#604

#6040

#6041

#6042

#6043

#6044

#6045

#6046

#6048

#6050

#6051

#6052

#6053

#6054

#6055

#6056

#6057

#6059

#6060

#6061

#6062

#6063

#6064

#6065

#6068

#6069

#607

#6070

#6071

#6072

#6073

#6073

#6074

#6075

#6077

#6078

#608

#6080

#6081

#6082

#6083

#6084

#6085

#6086

#6087

#6088

#6089

#609

#6090

#6092

#6093

#6094

#6096

#6098

#6099

#61

#610

#6100

#6104

#6106

#6107

#6109

#611

#6113

#6114

#6115

#6116

#6117

#6118

#6118

#6119

#612

#6121

#6122

#6122

#6123

#6124

#6124

#6125

#6126

#6127

#6127

#6128

#6129

#613

#6130

#6131

#6132

#6134

#6135

#6136

#6137

#6139

#614

#6140

#6141

#6142

#6143

#6144

#6145

#6146

#6147

#6148

#6149

#615

#6150

#6151

#6152

#6153

#6154

#6155

#6156

#6158

#6158

#6159

#616

#6162

#6162

#6163

#6164

#6165

#6166

#6168

#617

#6172

#6173

#6173

#6174

#6177

#6178

#6179

#6179

#618

#6181

#6181

#6183

#6184

#6185

#6186

#6187

#6188

#6189

#619

#6191

#6192

#6195

#6196

#6198

#6199

#62

#620

#6206

#6208

#621

#6210

#6213

#6214

#6218

#622

#6223

#6223

#6228

#6229

#623

#6230

#6231

#6236

#624

#6240

#6242

#6245

#6246

#6247

#625

#6250

#6251

#6252

#6254

#6255

#6257

#6258

#626

#6262

#6263

#6268

#6269

#627

#6270

#6271

#6273

#6274

#6275

#6276

#6277

#6278

#6278

#6279

#628

#6280

#6282

#6283

#6284

#6285

#6286

#6287

#6288

#6289

#629

#6290

#6291

#6292

#6293

#6294

#6295

#6296

#6297

#6298

#6299

#63

#630

#6300

#6301

#6302

#6303

#6304

#6305

#6306

#6307

#6308

#6309

#631

#6310

#6311

#6312

#6313

#6314

#6315

#6316

#6317

#6318

#6319

#632

#6320

#6321

#6322

#6323

#6324

#6325

#6326

#6327

#6328

#6329

#633

#6330

#6331

#6332

#6333

#6333

#6334

#6335

#6336

#6337

#6338

#6339

#634

#6340

#6341

#6343

#6344

#6346

#6347

#6348

#635

#6351

#6352

#6353

#6354

#6354

#6355

#6356

#6357

#636

#6360

#6361

#6362

#6363

#6364

#6366

#6368

#6368

#637

#6370

#6372

#6373

#6373

#6374

#6374

#6375

#6376

#6377

#6377

#6378

#638

#6383

#6384

#6384

#6385

#639

#6391

#6392

#6393

#6393

#6394

#6394

#6395

#6395

#6398

#6398

#64

#640

#6404

#6404

#6405

#6405

#6406

#6406

#6407

#6407

#6408

#6408

#641

#6410

#6410

#642

#645

#646

#647

#648

#649

#649

#65

#652

#655

#656

#657

#659

#66

#660

#661

#662

#664

#666

#667

#668

#67

#672

#673

#678

#679

#681

#683

#686

#687

#69

#691

#692

#694

#695

#699

#7

#70

#700

#701

#704

#705

#706

#707

#708

#71

#710

#711

#712

#715

#717

#717

#719

#72

#721

#723

#724

#725

#726

#727

#728

#729

#73

#730

#731

#732

#735

#738

#739

#74

#740

#741

#742

#743

#746

#747

#748

#749

#75

#750

#751

#752

#753

#754

#756

#758

#76

#760

#762

#763

#764

#765

#766

#769

#77

#770

#771

#772

#773

#775

#777

#779

#78

#781

#783

#784

#785

#788

#789

#79

#790

#791

#792

#793

#795

#797

#798

#799

#8

#80

#800

#801

#802

#803

#804

#805

#806

#807

#808

#809

#81

#810

#811

#812

#813

#815

#816

#818

#819

#82

#820

#821

#822

#823

#824

#825

#826

#827

#828

#829

#83

#830

#831

#832

#833

#834

#835

#837

#838

#839

#84

#840

#842

#843

#844

#845

#846

#847

#848

#849

#850

#852

#853

#854

#855

#856

#857

#858

#859

#86

#860

#861

#862

#863

#864

#865

#866

#867

#868

#869

#87

#870

#871

#872

#873

#874

#875

#876

#877

#878

#879

#88

#880

#881

#886

#887

#888

#889

#890

#893

#894

#895

#896

#897

#898

#899

#9

#90

#900

#901

#902

#903

#904

#905

#907

#909

#91

#910

#911

#912

#913

#914

#915

#916

#917

#918

#919

#92

#920

#921

#922

#923

#927

#928

#929

#93

#931

#932

#933

#934

#935

#936

#937

#938

#939

#94

#940

#941

#942

#943

#944

#945

#946

#947

#948

#949

#95

#950

#951

#952

#953

#954

#955

#956

#957

#958

#959

#96

#960

#961

#962

#963

#964

#965

#966

#967

#968

#969

#97

#970

#971

#972

#973

#974

#975

#976

#977

#978

#979

#98

#980

#981

#982

#983

#984

#986

#987

#99

#992

#997

#998

#999

v0.0.1-beta

v0.0.2

v0.1.0

v0.1.1

v0.1.10

v0.1.11rc1

v0.1.11rc2

v0.1.11rc3

v0.1.11rc4

v0.1.11rc5

v0.1.12

v0.1.13

v0.1.2

v0.1.3

v0.1.4

v0.1.5

v0.1.6

v0.1.7

v0.1.8

v0.1.9

v0.2.0

v0.2.1

v0.2.2

v0.2.3

v0.2.4

v0.2.5

v0.2.6

v0.2.7

v0.2.8

v0.3.0

v0.3.1

v0.3.2

v0.3.3

v0.3.4

v0.3.5

v0.3.6

v0.3.7

v0.3.8

v0.3.9

v0.4.0

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.4.5

v0.4.6

v0.4.7

v0.4.8

v0.4.9

v0.5.0

v0.5.1

Mono Color

• d5661f0f25 [nfc] fix typo change directoty to directory (#5111) digger yu 2023-11-27 18:25:53 +08:00
• 916459c99a [inference] Add model forward accuracy test (#5102) refactor/inference Yuanheng Zhao 2023-11-27 14:14:06 +08:00
• 2bdf76f1f2 fix typo change lazy_iniy to lazy_init (#5099) digger yu 2023-11-24 19:15:59 +08:00
• 68fcaa2225 remove duplicate import (#5100) Xuanlei Zhao 2023-11-23 15:15:01 +08:00
• e53e729d8e [Feature] Add document retrieval QA (#5020) YeAnbang 2023-11-23 10:33:48 +08:00
• 3acbf6d496 [npu] add npu support for hybrid plugin and llama (#5090) Xuanlei Zhao 2023-11-22 19:23:21 +08:00
• f196f40a8f [inference] decouple pipeline logci for chatglm (#5098) Hongxin Liu 2023-11-22 18:26:39 +08:00
• cb450c2861 [hotfix]fix chatglm rmsnorm (#5079) Jianghai 2023-11-22 17:59:22 +08:00
• 67a07e6f64 [inference] decouple pipeline logci for bloom (#5097) Hongxin Liu 2023-11-22 17:49:25 +08:00
• afe3c78d9a add lightllm rmsnorm (#5096) Cuiqing Li (李崔卿) 2023-11-22 17:05:34 +08:00
• aae496631c [shardformer]fix flash attention, when mask is casual, just don't unpad it (#5084) flybird11111 2023-11-22 16:00:07 +08:00
• 27e62ba0f7 [inference] decouple pp logic for llama (#5092) Hongxin Liu 2023-11-22 13:53:08 +08:00
• 75af66cd81 [Hotfix] Fix model policy matching strategy in ShardFormer (#5064) Zhongkai Zhao 2023-11-22 11:19:39 +08:00
• 4ccb9ded7d [gemini]fix gemini optimzer, saving Shardformer in Gemini got list assignment index out of range (#5085) flybird11111 2023-11-22 11:14:25 +08:00
• 0d482302a1 [nfc] fix typo and author name (#5089) digger yu 2023-11-22 10:39:01 +08:00
• fd3567e089 [nfc] fix typo in docs/ (#4972) digger yu 2023-11-21 22:06:20 +08:00
• 79c4bff452 [doc] Update the user guide and the development document in Colossal-Inference (#5086) Zhongkai Zhao 2023-11-21 18:58:04 +08:00
• 42b2d6f3a5 [example] add vllm inference benchmark (#5080) Hongxin Liu 2023-11-21 13:28:13 +08:00
• dce05da535 fix thrust-transform-reduce error (#5078) Jun Gao 2023-11-21 15:09:35 +08:00
• 1cd7efc520 [inference] refactor examples and fix schedule (#5077) Hongxin Liu 2023-11-21 10:46:03 +08:00
• 4e3959d316 [hotfix/hybridengine] Fix init model with random parameters in benchmark (#5074) Bin Jia 2023-11-20 20:15:25 +08:00
• 8921a73c90 [format] applied code formatting on changed files in pull request 5067 (#5072) github-actions[bot] 2023-11-20 19:46:43 +08:00
• fb103cfd6e [inference] update examples and engine (#5073) Xu Kai 2023-11-20 19:44:52 +08:00
• 0c7d8bebd5 [hotfix/hybridengine] fix bug when tp*pp size = 1 (#5069) Bin Jia 2023-11-20 17:15:37 +08:00
• e5ce4c8ea6 [npu] add npu support for gemini and zero (#5067) Hongxin Liu 2023-11-20 16:12:41 +08:00
• 8d56c9c389 [misc] remove outdated submodule (#5070) Hongxin Liu 2023-11-20 15:27:44 +08:00
• bce919708f [Kernels]added flash-decoidng of triton (#5063) Cuiqing Li (李崔卿) 2023-11-20 13:58:29 +08:00
• fd6482ad8c [inference] Refactor inference architecture (#5057) Xu Kai 2023-11-19 21:05:05 +08:00
• bc09b95f50 [exampe] fix llama example' loss error when using gemini plugin (#5060) flybird11111 2023-11-18 18:41:58 +08:00
• 3c08f17348 [hotfix]: modify create_ep_hierarchical_group and add test (#5032) Wenhao Chen 2023-11-17 10:53:00 +08:00
• 97cd0cd559 [shardformer] fix llama error when transformers upgraded. (#5055) flybird11111 2023-11-16 21:34:04 +08:00
• 3e02154710 [gemini] gemini support extra-dp (#5043) flybird11111 2023-11-16 21:03:04 +08:00
• b2ad0d9e8f [pipeline,shardformer] Fix p2p efficiency in pipeline, allow skipping loading weight not in weight_map when strict=False, fix llama flash attention forward, add flop estimation by megatron in llama benchmark (#5017) Elsa Granger 2023-11-16 20:15:59 +08:00
• 28052a71fb [Kernels]Update triton kernels into 2.1.0 (#5046) Cuiqing Li (李崔卿) 2023-11-16 16:43:15 +08:00
• 20332a7a34 [inference] udpate example (#5053) feature/inference-refactor Xu Kai 2023-11-16 11:07:43 +08:00
• 5446fb70c4 [inference] update readme (#5051) Xu Kai 2023-11-16 09:10:57 +08:00
• 361cf63cb0 [Refactor] refactor policy search and quant type controlling in inference (#5035) Zhongkai Zhao 2023-11-14 17:26:59 +08:00
• 43ad0d9ef0 fix wrong EOS token in ColossalChat Orion-Zheng 2023-11-14 09:58:00 +08:00
• c6295c3381 [Refactor] remove useless inference code (#5022) Xu Kai 2023-11-10 14:47:06 +08:00
• 70885d707d [hotfix] Suport extra_kwargs in ShardConfig (#5031) Zhongkai Zhao 2023-11-10 10:49:50 +08:00
• 576a2f7b10 [gemini] gemini support tensor parallelism. (#4942) flybird11111 2023-11-10 10:15:16 +08:00
• a4489384d5 [shardformer] Fix serialization error with Tensor Parallel state saving (#5018) Jun Gao 2023-11-09 17:00:25 +08:00
• 81b8f5e76a [Inference Refactor] Merge chatglm2 with pp and tp (#5023) Bin Jia 2023-11-09 14:46:19 +08:00
• 724441279b [moe]: fix ep/tp tests, add hierarchical all2all (#4982) Wenhao Chen 2023-11-09 14:31:00 +08:00
• 239cd92eff Support mtbench (#5025) Yuanchen 2023-11-09 13:41:50 +08:00
• 450115bd0f [refactor] refactor gptq and smoothquant llama (#5012) Xu Kai 2023-11-08 09:17:52 +08:00
• 48d0a58d10 add support for bloom (#5008) Bin Jia 2023-11-06 09:35:33 +08:00
• f747d13040 [inference] support only TP (#4998) Xu Kai 2023-11-01 16:33:30 +08:00
• f71e63b0f3 [moe] support optimizer checkpoint (#5015) Xuanlei Zhao 2023-11-08 23:07:03 +08:00
• 67f5331754 [misc] add code owners (#5024) Hongxin Liu 2023-11-08 15:18:51 +08:00
• ef4c14a5e2 [Inference] Fix bug in ChatGLM2 Tensor Parallelism (#5014) Jianghai 2023-11-07 15:01:50 +08:00
• c36e782d80 [format] applied code formatting on changed files in pull request 4926 (#5007) github-actions[bot] 2023-11-06 17:08:12 +08:00
• 1a3315e336 [hotfix] Add layer norm gradients all-reduce for sequence parallel (#4926) littsk 2023-11-03 13:32:43 +08:00
• d99b2c961a [hotfix] fix grad accumulation plus clipping for gemini (#5002) Baizhou Zhang 2023-11-02 17:59:10 +08:00
• dc003c304c [moe] merge moe into main (#4978) Xuanlei Zhao 2023-11-02 10:21:24 +08:00
• 8993c8a817 [release] update version (#4995) v0.3.4 Hongxin Liu 2023-11-01 13:41:22 +08:00
• b6696beb04 [Pipeline Inference] Merge pp with tp (#4993) Bin Jia 2023-11-01 12:46:21 +08:00
• 335cb105e2 [doc] add supported feature diagram for hybrid parallel plugin (#4996) ppt0011 2023-10-31 19:56:42 +08:00
• c5fd4aa6e8 [lora] add lora APIs for booster, support lora for TorchDDP (#4981) Baizhou Zhang 2023-10-31 15:19:37 +08:00
• c040d70aa0 [hotfix] fix the bug of repeatedly storing param group (#4951) Baizhou Zhang 2023-10-31 14:48:01 +08:00
• be82b5d4ca [hotfix] Fix the bug where process groups were not being properly released. (#4940) littsk 2023-10-31 14:47:30 +08:00
• 4f0234f236 [doc]Update doc for colossal-inference (#4989) Cuiqing Li (李崔卿) 2023-10-31 10:48:07 +08:00
• abe071b663 fix ColossalEval (#4992) Yuanchen 2023-10-31 10:30:03 +08:00
• 459a88c806 [Kernels]Updated Triton kernels into 2.1.0 and adding flash-decoding for llama token attention (#4965) Cuiqing Li 2023-10-30 14:04:37 +08:00
• cf579ff46d [Inference] Dynamic Batching Inference, online and offline (#4953) Jianghai 2023-10-30 10:52:19 +08:00
• 4e4a10c97d updated c++17 compiler flags (#4983) アマデウス 2023-10-27 18:19:56 +08:00
• 1db6727678 [Pipeline inference] Combine kvcache with pipeline inference (#4938) Bin Jia 2023-10-27 16:19:54 +08:00
• 8b1b237a5f 1st try on restore bert's cache during testing hotfix/example_test Orion-Zheng 2023-10-26 10:49:47 +08:00
• 65f8d8b5bb 1st try on cache bert weight Orion-Zheng 2023-10-26 00:43:37 +08:00
• c6cd629e7a [Inference]ADD Bench Chatglm2 script (#4963) Jianghai 2023-10-24 13:11:15 +08:00
• 785802e809 [inference] add reference and fix some bugs (#4937) Xu Kai 2023-10-20 13:39:34 +08:00
• b8e770c832 [test] merge old components to test to model zoo (#4945) Hongxin Liu 2023-10-20 10:35:08 +08:00
• 3a41e8304e [Refactor] Integrated some lightllm kernels into token-attention (#4946) Cuiqing Li 2023-10-19 22:22:47 +08:00
• 11009103be [nfc] fix some typo with colossalai/ docs/ etc. (#4920) digger yu 2023-10-18 15:44:04 +08:00
• 486d06a2d5 [format] applied code formatting on changed files in pull request 4820 (#4886) github-actions[bot] 2023-10-18 11:46:37 +08:00
• c7aa319ba0 [test] add no master test for low level zero plugin (#4934) Zhongkai Zhao 2023-10-18 11:41:23 +08:00
• 1f5d2e8062 [hotfix] fix torch 2.0 compatibility (#4936) Hongxin Liu 2023-10-18 11:05:25 +08:00
• 21ba89cab6 [gemini] support gradient accumulation (#4869) Baizhou Zhang 2023-10-17 14:07:21 +08:00
• a41cf88e9b [format] applied code formatting on changed files in pull request 4908 (#4918) github-actions[bot] 2023-10-17 10:48:24 +08:00
• 4f68b3f10c [kernel] support pure fp16 for cpu adam and update gemini optim tests (#4921) Hongxin Liu 2023-10-16 21:56:53 +08:00
• 7768afbad0 Update flash_attention_patch.py Zian(Andy) Zheng 2023-10-13 16:46:33 +08:00
• 611a5a80ca [inference] Add smmoothquant for llama (#4904) Xu Kai 2023-10-16 11:28:44 +08:00
• a0684e7bd6 [feature] support no master weights option for low level zero plugin (#4816) Zhongkai Zhao 2023-10-13 15:57:45 +08:00
• 77a9328304 [inference] add llama2 support (#4898) Xu Kai 2023-10-13 13:09:23 +08:00
• 39f2582e98 [hotfix] fix lr scheduler bug in torch 2.0 (#4864) Baizhou Zhang 2023-10-12 14:04:24 +08:00
• 83b52c56cd [feature] Add clip_grad_norm for hybrid_parallel_plugin (#4837) littsk 2023-10-12 11:32:37 +08:00
• df63564184 [gemini] support amp o3 for gemini (#4872) Hongxin Liu 2023-10-12 10:39:08 +08:00
• c1fab951e7 Merge pull request #4889 from ppt0011/main ppt0011 2023-10-12 10:27:10 +08:00
• ffd9a3cbc9 [hotfix] fix bug in sequence parallel test (#4887) littsk 2023-10-11 19:30:41 +08:00
• 1dcaf249bd [doc] add reminder for issue encountered with hybrid adam ppt0011 2023-10-11 17:48:21 +08:00
• fdec650bb4 fix test llama (#4884) Xu Kai 2023-10-11 17:43:01 +08:00
• 08a9f76b2f [Pipeline Inference] Sync pipeline inference branch to main (#4820) Bin Jia 2023-10-11 11:40:06 +08:00
• 652adc2215 Update README.md Camille Zhong 2023-10-10 15:52:18 +08:00
• afe10a85fd Update README.md Camille Zhong 2023-10-10 15:18:13 +08:00
• d6c4b9b370 Update main README.md Camille Zhong 2023-10-10 15:13:09 +08:00
• 3043d5d676 Update modelscope link in README.md Camille Zhong 2023-10-10 15:01:33 +08:00
• 6a21f96a87 [doc] update advanced tutorials, training gpt with hybrid parallelism (#4866) flybird11111 2023-10-10 16:18:55 +08:00
• 8aed02b957 [nfc] fix minor typo in README (#4846) Blagoy Simandoff 2023-10-07 10:51:11 +01:00
• cd6a962e66 [NFC] polish code style (#4799) Camille Zhong 2023-09-27 10:42:11 +08:00
• 07ed155e86 [NFC] polish colossalai/inference/quant/gptq/cai_gptq/__init__.py code style (#4792) Michelle 2023-09-27 10:33:13 +08:00