Commit Graph

Select branches

Hide Pull Requests

ColossalChat

ckpt_api

cloud/coati

colossalchat

colossalchat_upgrade

dev/gpt2_metainfo_patch

dev/zero-offload

develop

feat/agpo

feat/boxed-version

feat/grpo

feat/hybrid_model_sync

feat/online-serving

feat/ppo

feat/speculative-decoding

feature/2-stage

feature/async-io

feature/colossal-infer

feature/dist-ckp-io

feature/dualpipe

feature/elixir

feature/inference-refactor

feature/lora

feature/ray-rlhf

feature/stable-diffusion

feature/zerobubble

fix-setup

flybird11111-patch-1

grpo-agentic-dev

grpo-code

grpo-dev

grpo-latest

grpo-latest-ascend

grpo-latest-dev

grpo-latest-dev-debug

grpo-latest-dev-reward-update

grpo-latest-rebase-main

grpo-latest-revert

grpo-latest-support-entropy-metric

grpo-latest-v3

grpo-profile

grpo-reward-dev

grpo-support-multi-machine

grpo-zero-bubble

grpo-zero-bubble-rebase

grpo_optimization

hotfix/example_test

hotfix/kernel_build_before_load

hotfix/tp-issue

hpc-ai-cloud

main

moe_sp

pre-commit-ci-update-config

refactor/inference

release/v0.5.0

revert-6292-grpo-latest-dev-reward-update

supercooledith-patch-1

support-npu

upgrade_transformers

uxsqN94oMfWTUNCA

#10

#100

#1000

#1001

#1003

#1004

#1005

#1007

#1008

#1009

#101

#1010

#1011

#1012

#1015

#1016

#1017

#1018

#1019

#1020

#1021

#1022

#1024

#1025

#1026

#1027

#1029

#1030

#1031

#1034

#1040

#1041

#1042

#1044

#1045

#1046

#1047

#1048

#1049

#1050

#1052

#1053

#1054

#1059

#1062

#1063

#1066

#1068

#1069

#1070

#1071

#1072

#1073

#1075

#1076

#1077

#1078

#108

#1080

#1081

#1086

#1087

#1088

#1089

#1090

#1091

#1093

#1094

#1096

#1097

#1098

#1099

#11

#1100

#1101

#1102

#1103

#1105

#1106

#1108

#111

#1115

#1117

#1118

#1119

#112

#1120

#1121

#1122

#1123

#1125

#1127

#1128

#1129

#113

#1130

#1131

#1133

#1134

#1135

#1136

#1137

#1138

#1139

#114

#1140

#1142

#1143

#1144

#1145

#1146

#1147

#1148

#115

#1150

#1151

#1152

#1153

#1154

#1155

#1156

#1157

#1158

#1159

#1160

#1161

#1163

#1164

#1165

#1166

#1167

#1168

#1169

#1170

#1171

#1172

#1173

#1174

#1175

#1176

#1177

#1178

#1179

#118

#1181

#1182

#1185

#1186

#1187

#1188

#1189

#1191

#1192

#1193

#1194

#1196

#1197

#1198

#1199

#12

#1200

#1201

#1202

#1203

#1204

#1207

#1208

#1209

#1210

#1211

#1212

#1213

#1214

#1215

#1216

#1217

#1219

#1220

#1221

#1222

#1223

#1224

#1225

#1226

#1227

#1228

#1229

#123

#1230

#1231

#1232

#1233

#1234

#1235

#1236

#1237

#1238

#1239

#1240

#1241

#1242

#1243

#1244

#1245

#1246

#1247

#1248

#1248

#125

#1250

#1251

#1252

#1253

#1254

#1255

#1256

#1257

#1258

#1259

#126

#1260

#1261

#1262

#1263

#1264

#1265

#1266

#1267

#1268

#1269

#127

#1270

#1271

#1272

#1273

#1274

#1275

#1276

#1277

#1278

#1279

#128

#1280

#1281

#1282

#1283

#1284

#1285

#1286

#1287

#1288

#1288

#1289

#129

#1290

#1291

#1292

#1293

#1294

#1295

#1296

#1297

#1298

#1299

#13

#130

#1300

#1301

#1302

#1303

#1305

#1306

#1307

#1308

#1309

#1310

#1311

#1312

#1313

#1314

#1315

#1316

#1318

#1319

#132

#1320

#1321

#1323

#1324

#1325

#1326

#1327

#1328

#1329

#133

#1331

#1332

#1333

#1334

#1335

#1336

#1338

#1339

#1340

#1342

#1343

#1344

#1345

#1346

#1347

#1348

#1349

#135

#1350

#1351

#1352

#1353

#1354

#1355

#1357

#1358

#1359

#1360

#1361

#1362

#1363

#1364

#1366

#1367

#1368

#1369

#137

#1370

#1372

#1373

#1374

#1376

#1377

#1378

#1379

#138

#1380

#1381

#1382

#1383

#1384

#1385

#1386

#1387

#1388

#1391

#1392

#1393

#1394

#1395

#1396

#1397

#1398

#1399

#14

#140

#1403

#1404

#1405

#1406

#1407

#1408

#1409

#141

#1410

#1415

#1416

#1417

#1418

#1419

#142

#1421

#1422

#1423

#1424

#1425

#1426

#1428

#1429

#143

#1430

#1431

#1432

#1433

#1435

#1436

#1437

#1438

#1439

#144

#1441

#1442

#1444

#1446

#1447

#1448

#1449

#145

#1450

#1451

#1452

#1453

#1456

#1457

#1458

#1459

#146

#1460

#1461

#1462

#1463

#1464

#1465

#1466

#1467

#1468

#1469

#147

#1470

#1471

#1472

#1473

#1475

#1476

#1477

#1478

#1479

#148

#1480

#1481

#1482

#1483

#1484

#1486

#1487

#1488

#1489

#1490

#1492

#1493

#1494

#1495

#1496

#1497

#1499

#15

#1500

#1501

#1502

#1503

#1504

#1505

#1506

#1507

#1508

#1509

#151

#1510

#1511

#1512

#1513

#1514

#1515

#1516

#1518

#1519

#152

#1520

#1521

#1522

#1523

#1524

#1525

#1526

#1527

#1528

#1529

#153

#1530

#1531

#1532

#1533

#1534

#1535

#1536

#1537

#1538

#1539

#154

#1541

#1542

#1543

#1544

#1545

#1546

#1547

#1548

#1549

#1550

#1551

#1552

#1553

#1554

#1555

#1556

#1557

#1558

#1559

#156

#1560

#1561

#1562

#1563

#1564

#1565

#1566

#1567

#1568

#1569

#157

#1570

#1571

#1572

#1573

#1574

#1575

#1576

#1578

#1581

#1583

#1584

#1585

#1586

#1587

#1588

#1589

#159

#1590

#1591

#1594

#1595

#1596

#1597

#1598

#1599

#160

#1600

#1601

#1602

#1603

#1604

#1605

#1606

#1607

#1608

#1609

#161

#1610

#1611

#1612

#1613

#1614

#1615

#1616

#1617

#1618

#1619

#162

#1620

#1621

#1622

#1623

#1624

#1625

#1628

#1629

#163

#1630

#1631

#1633

#1634

#1635

#1636

#1637

#1638

#1639

#164

#1640

#1641

#1642

#1643

#1644

#1645

#1646

#1647

#1648

#1649

#165

#1650

#1651

#1652

#1653

#1654

#1655

#1656

#1657

#1658

#1659

#166

#1660

#1661

#1662

#1663

#1664

#1665

#1666

#1667

#1669

#167

#1670

#1671

#1673

#1674

#1676

#1677

#1678

#1679

#168

#1680

#1681

#1682

#1683

#1684

#1686

#1687

#1688

#1689

#1690

#1691

#1692

#1694

#1695

#1696

#1697

#1698

#1699

#17

#1700

#1701

#1702

#1703

#1704

#1705

#1706

#1707

#1708

#1709

#171

#1710

#1711

#1712

#1713

#1714

#1715

#1716

#1717

#1718

#1719

#172

#1720

#1721

#1722

#1723

#1724

#1725

#1726

#1727

#1728

#1729

#173

#1730

#1731

#1732

#1733

#1734

#1735

#1736

#1739

#174

#1740

#1741

#1742

#1743

#1744

#1745

#1746

#1747

#1748

#1750

#1751

#1752

#1753

#1754

#1755

#1757

#1758

#1759

#176

#1760

#1762

#1763

#1764

#1765

#1766

#1767

#1768

#1769

#1770

#1771

#1772

#1775

#1776

#1778

#178

#1780

#1781

#1782

#1783

#1784

#1785

#1786

#1787

#1788

#1789

#179

#1790

#1791

#1792

#1793

#1796

#1797

#1798

#1799

#18

#1800

#1801

#1802

#1803

#1804

#1805

#1806

#1807

#1808

#1809

#1810

#1811

#1812

#1813

#1814

#1815

#1816

#1817

#1818

#1819

#1820

#1821

#1822

#1823

#1824

#1825

#1826

#1827

#1828

#1829

#183

#1830

#1831

#1832

#1833

#1834

#1835

#1836

#1837

#184

#1840

#1842

#1843

#1844

#1845

#1846

#1847

#1848

#1849

#1851

#1852

#1853

#1854

#1855

#1856

#1857

#1858

#1859

#186

#1860

#1865

#1866

#1867

#1868

#1869

#187

#1871

#1873

#1874

#1875

#1876

#1877

#1878

#1879

#188

#1880

#1889

#189

#1891

#1893

#1894

#1895

#1896

#1897

#1898

#1899

#19

#190

#1901

#1902

#1903

#1904

#1905

#1906

#1907

#1908

#1909

#191

#1910

#1916

#1917

#1918

#1919

#192

#1920

#1921

#1922

#1924

#1925

#1927

#1928

#193

#1930

#1931

#1937

#1938

#1939

#194

#1940

#1941

#1942

#1943

#1944

#1946

#1950

#1950

#1952

#1953

#1954

#1955

#1957

#1958

#1959

#196

#1960

#1961

#1962

#1963

#1964

#1967

#1968

#197

#1970

#1971

#1972

#1973

#1974

#1977

#1978

#1979

#198

#1980

#1981

#1982

#1984

#1985

#1986

#1987

#1989

#1990

#1998

#1999

#2

#20

#200

#2000

#2001

#2002

#2003

#2004

#2005

#2006

#2007

#2008

#2009

#201

#2010

#2011

#2015

#2016

#2017

#2018

#2019

#202

#2020

#2021

#2021

#2022

#2023

#2025

#2027

#2028

#2029

#203

#2030

#2032

#2033

#2034

#2035

#2036

#2037

#2038

#2039

#204

#2040

#2042

#2043

#2045

#2046

#2047

#2048

#205

#2050

#2051

#2052

#2053

#2058

#2059

#2060

#2061

#2062

#2064

#2065

#2066

#2069

#2071

#2072

#2073

#2074

#2075

#2076

#2077

#2078

#2079

#2080

#2081

#2082

#2083

#2084

#2085

#2086

#2087

#2088

#2089

#209

#2090

#2091

#2092

#2095

#2096

#2097

#2098

#2099

#21

#210

#2101

#2102

#2103

#2104

#2105

#2106

#2107

#2108

#2110

#2111

#2112

#2113

#2115

#2116

#2117

#2118

#2119

#212

#2120

#2123

#2124

#2125

#2126

#2127

#2128

#2129

#213

#2130

#2131

#2132

#2133

#2134

#2136

#2137

#2138

#2139

#214

#2144

#2146

#2147

#2148

#2149

#215

#2150

#2151

#2152

#2153

#2154

#2155

#2156

#2157

#2158

#2159

#2162

#2163

#2164

#2165

#2167

#2168

#2168

#2169

#217

#2171

#2172

#2173

#2174

#2175

#2177

#2178

#2179

#218

#2184

#2186

#2187

#2188

#2189

#219

#2190

#2191

#2193

#2194

#2195

#2196

#2197

#220

#2200

#2201

#2202

#2203

#2206

#2207

#2208

#2209

#221

#2210

#2211

#2212

#2213

#2214

#2216

#2217

#2219

#222

#2221

#2222

#2223

#2224

#2225

#2226

#2227

#2228

#2229

#223

#2231

#2232

#2234

#2237

#2238

#2239

#224

#2242

#2243

#2244

#2245

#2247

#2248

#2254

#2257

#2258

#226

#2261

#2262

#2263

#2264

#2265

#2266

#2267

#2268

#2268

#2269

#227

#2270

#2271

#2272

#2273

#2274

#2275

#2276

#2277

#2278

#2279

#2280

#2281

#2282

#2283

#2284

#2286

#2287

#2288

#2289

#229

#2290

#2291

#2292

#2293

#2295

#2296

#2297

#2298

#2299

#23

#2300

#2301

#2302

#2303

#2304

#2305

#2306

#2307

#2308

#2310

#2311

#2312

#2313

#2314

#2315

#2316

#2317

#2318

#2319

#232

#2320

#2322

#2323

#2326

#2327

#2328

#2329

#233

#2333

#2336

#2338

#2339

#2340

#2342

#2344

#2345

#2348

#2349

#2350

#2352

#2353

#2354

#2355

#2356

#2357

#2358

#2359

#2363

#2364

#2365

#2366

#2367

#2368

#2370

#2371

#2372

#2373

#2374

#2375

#2379

#2381

#2385

#2387

#2389

#2390

#2393

#2395

#2396

#2396

#2397

#2399

#24

#240

#2400

#2401

#2403

#2404

#2405

#2406

#2408

#2410

#2411

#2412

#2413

#2414

#2415

#2416

#2417

#2418

#2419

#242

#2420

#2423

#2424

#2427

#243

#2431

#2432

#2434

#2436

#2438

#244

#2442

#2443

#2444

#2445

#2446

#2448

#2449

#245

#2451

#2452

#2453

#2456

#2459

#246

#2463

#2464

#2465

#2466

#2468

#2469

#2471

#2473

#2474

#2475

#2476

#2477

#248

#2481

#2482

#2483

#2484

#2485

#2486

#2488

#249

#2492

#2494

#2495

#2497

#2498

#2499

#25

#2502

#2503

#2504

#2506

#2507

#2508

#2509

#251

#2510

#2511

#2512

#2514

#2515

#2516

#2517

#2518

#2519

#252

#2520

#2521

#2522

#2523

#2524

#2525

#2526

#2527

#2528

#2529

#253

#2532

#2533

#2534

#2537

#2538

#2540

#2543

#2544

#2545

#2549

#255

#2550

#2552

#2554

#2556

#2558

#2560

#2561

#2564

#2565

#2567

#2568

#2572

#2574

#2577

#2578

#2581

#2584

#2585

#2586

#2589

#2591

#2594

#2596

#2598

#2600

#2601

#2602

#2604

#2607

#2608

#2611

#2613

#2614

#2615

#2618

#2619

#2621

#2623

#2624

#2625

#2626

#263

#2635

#2637

#264

#2641

#2643

#2644

#2647

#2648

#265

#2652

#2656

#2657

#2658

#2659

#266

#2661

#2664

#2665

#2666

#2669

#267

#2670

#2671

#2672

#2674

#2675

#2678

#268

#2680

#2681

#2683

#2686

#2687

#2689

#2689

#269

#2690

#2691

#2692

#2693

#2694

#2695

#2696

#2698

#2699

#27

#270

#2700

#2701

#2701

#2702

#2702

#2703

#2704

#2705

#2706

#2707

#2708

#2709

#271

#2711

#2712

#2713

#2714

#2715

#2716

#2717

#2719

#272

#2720

#2721

#2723

#2725

#2726

#2727

#2728

#273

#2730

#2734

#2736

#2737

#2738

#274

#2740

#2741

#2742

#2744

#2747

#2749

#2749

#275

#2754

#276

#2760

#2762

#2764

#2766

#2767

#2769

#277

#2773

#2775

#2777

#2789

#279

#2791

#2792

#2796

#2797

#2798

#28

#280

#2803

#2804

#281

#2812

#2813

#2817

#282

#2820

#2821

#2822

#2823

#2824

#2826

#2829

#283

#2835

#2837

#284

#2846

#2848

#2849

#285

#2852

#2854

#286

#2860

#2863

#2867

#2869

#287

#2871

#2876

#288

#2880

#2886

#2895

#29

#291

#2912

#2914

#292

#2920

#2922

#2923

#2925

#2927

#2929

#293

#2930

#2932

#2933

#2935

#2939

#294

#2944

#2946

#2951

#2954

#296

#2964

#2966

#2969

#297

#2971

#2974

#2977

#298

#2982

#2983

#2984

#2986

#2987

#2988

#299

#2993

#2994

#2996

#2997

#2999

#3

#30

#300

#3006

#3008

#301

#3014

#3017

#3019

#302

#3020

#3022

#3025

#3026

#3028

#3029

#303

#3032

#3034

#3037

#304

#3042

#305

#3055

#3056

#3057

#3058

#306

#3062

#3065

#307

#3070

#3072

#3073

#3075

#3079

#308

#3080

#3082

#3084

#3085

#3086

#3087

#3089

#309

#3093

#3094

#3098

#3099

#310

#3101

#3104

#3105

#3107

#3108

#311

#3113

#3116

#312

#3121

#3122

#3128

#3129

#313

#3131

#3132

#3133

#3135

#3136

#3138

#3139

#3147

#315

#3151

#3153

#3154

#3157

#3159

#316

#3162

#3166

#3167

#317

#3170

#3173

#3174

#3177

#3178

#3180

#3181

#3183

#3185

#3186

#3188

#3190

#3191

#3194

#3195

#3197

#3199

#32

#320

#3204

#3205

#3206

#3207

#3209

#321

#3211

#3213

#3216

#3218

#3219

#322

#3221

#3222

#3223

#3225

#3227

#3229

#323

#3230

#3232

#3233

#3236

#3238

#3239

#324

#3241

#3244

#325

#3253

#3254

#3255

#3256

#3257

#3259

#3260

#3261

#3262

#3263

#3265

#3266

#3268

#3269

#327

#3270

#3272

#3273

#3274

#3275

#3276

#3277

#3279

#328

#3282

#3283

#3284

#3285

#3286

#3287

#3288

#3289

#329

#3290

#3292

#3293

#3294

#3295

#3296

#3297

#3298

#3299

#33

#330

#3300

#3301

#3302

#3304

#3305

#3306

#3307

#3308

#3309

#331

#3311

#3312

#3313

#3315

#3318

#332

#3323

#3327

#3329

#333

#3332

#3333

#3338

#334

#3343

#3346

#3347

#335

#3352

#3354

#336

#3367

#3368

#337

#3377

#3378

#3379

#338

#3384

#3386

#339

#3398

#34

#340

#3405

#3408

#341

#3411

#3417

#3418

#342

#3420

#3424

#3427

#3429

#343

#3431

#3433

#3436

#344

#3442

#3445

#3448

#345

#3450

#3452

#3453

#346

#3461

#3465

#347

#3472

#3473

#3474

#3475

#3476

#3477

#3479

#348

#3481

#3486

#3488

#349

#3493

#3497

#35

#350

#3504

#3506

#351

#3513

#3516

#3517

#3519

#352

#3520

#3522

#3525

#353

#3536

#354

#3541

#3548

#3549

#355

#3551

#3552

#3553

#3557

#356

#3561

#3563

#3567

#3567

#3568

#357

#3572

#3573

#3577

#3578

#3579

#358

#3581

#3586

#3588

#3589

#359

#3590

#3592

#3593

#3594

#3596

#3597

#36

#360

#3603

#3605

#3608

#361

#3610

#3611

#3612

#3618

#3619

#362

#3621

#3623

#3625

#3627

#3628

#363

#3632

#364

#3641

#3645

#3646

#3647

#3648

#365

#3652

#3653

#3654

#3655

#3656

#366

#3662

#3663

#3666

#3667

#3668

#367

#3671

#3679

#368

#3680

#3684

#3688

#369

#3691

#3692

#3693

#3694

#3695

#3697

#3699

#3699

#370

#3706

#3707

#3709

#371

#3710

#3711

#3713

#3715

#3718

#3719

#372

#3722

#3725

#3727

#3728

#3729

#373

#3730

#3731

#3735

#374

#3740

#3742

#3744

#3748

#375

#3751

#3754

#3756

#3758

#3759

#376

#3763

#3765

#3767

#377

#3770

#3771

#3772

#3774

#3775

#3778

#3779

#378

#3780

#3781

#3782

#3783

#3785

#3786

#3787

#3788

#3789

#379

#3792

#3794

#3795

#3799

#38

#380

#3801

#3804

#3805

#3806

#3807

#3808

#3809

#381

#3810

#3813

#3815

#3816

#3817

#382

#3820

#3821

#3822

#3823

#3824

#3825

#3826

#3827

#3828

#3829

#383

#3830

#3831

#3833

#3834

#3835

#3838

#384

#3841

#3842

#3844

#3845

#3846

#3847

#3849

#385

#3850

#3855

#3856

#386

#3860

#3862

#3864

#3865

#3868

#3869

#387

#3871

#3872

#3873

#3877

#3878

#3879

#388

#3880

#3882

#3883

#3884

#3885

#3887

#389

#3890

#3891

#3896

#3898

#3899

#39

#390

#3900

#3901

#3902

#3905

#3907

#3908

#3909

#391

#3910

#3911

#3913

#3915

#3916

#3917

#3918

#3919

#392

#3920

#3922

#3923

#3924

#3925

#3926

#3928

#3929

#393

#3930

#3931

#3932

#3934

#3936

#3937

#3939

#394

#3940

#3942

#3943

#3944

#3946

#3947

#3949

#395

#3956

#3960

#3963

#3967

#3968

#3969

#397

#3970

#3972

#3976

#3976

#3979

#3980

#3984

#3985

#3987

#3988

#399

#3990

#3991

#3993

#3994

#3996

#3999

#4

#40

#400

#4001

#4002

#4004

#4006

#4006

#401

#4011

#4013

#4014

#4016

#4018

#4019

#402

#4020

#4021

#4022

#4024

#4025

#4026

#4028

#403

#4030

#4033

#4034

#4036

#4039

#404

#4041

#4043

#4045

#4046

#4046

#4047

#4048

#4049

#4053

#4055

#4056

#4058

#406

#4060

#4062

#4064

#4065

#4067

#4068

#4068

#4069

#407

#4070

#4072

#4073

#4075

#4079

#4080

#4081

#4082

#4083

#4086

#4087

#4089

#409

#4090

#4091

#4093

#4094

#4096

#4098

#41

#410

#4100

#4101

#4103

#4105

#4106

#4107

#4109

#411

#4111

#4112

#4115

#4117

#412

#4122

#4124

#4126

#4127

#4129

#413

#4130

#4132

#4137

#4138

#4139

#414

#4141

#4142

#4144

#4145

#4146

#4147

#4149

#4152

#4153

#4155

#4157

#4158

#4159

#416

#4160

#4161

#4162

#4163

#4165

#4166

#4167

#4169

#417

#4171

#4172

#4173

#4174

#4175

#4176

#4178

#4179

#418

#4180

#4182

#4185

#4187

#4188

#419

#4191

#4192

#4194

#4196

#4197

#42

#420

#4202

#4203

#4205

#4206

#4208

#421

#4210

#4212

#4213

#4214

#4215

#4216

#4217

#4218

#422

#4221

#4223

#4224

#4225

#4226

#4227

#4228

#4229

#423

#423

#4231

#4233

#4234

#4236

#4237

#4238

#4239

#424

#4240

#4241

#4243

#4244

#4245

#4246

#4248

#4250

#4251

#4252

#4253

#4254

#4255

#4256

#4257

#4258

#4259

#426

#4260

#4261

#4263

#4264

#4265

#4266

#4267

#4268

#4269

#427

#4270

#4271

#4272

#4273

#4274

#4275

#4276

#4277

#4278

#4279

#428

#4283

#4284

#4287

#4288

#429

#4290

#4291

#4293

#4295

#4297

#4299

#43

#430

#4300

#4301

#4302

#4303

#4305

#4306

#4307

#4309

#4309

#431

#4310

#4312

#4313

#4314

#4315

#4316

#4317

#432

#4320

#4321

#4323

#4324

#4325

#4329

#433

#4330

#4331

#4332

#4333

#4334

#4336

#4338

#434

#4340

#4341

#4345

#4346

#4347

#4349

#435

#4350

#4352

#4354

#4355

#4356

#4357

#4358

#4359

#436

#4362

#4363

#4366

#4369

#4372

#4377

#4379

#438

#4380

#4382

#4384

#4386

#4388

#4389

#439

#4392

#4395

#4396

#4398

#4399

#44

#440

#4401

#4403

#4404

#4405

#4407

#4408

#4409

#441

#4413

#4415

#4416

#442

#4420

#4421

#4423

#4424

#4426

#4426

#4428

#4429

#4430

#4431

#4432

#4433

#4434

#4435

#4436

#4440

#4441

#4443

#4445

#4446

#4448

#445

#4450

#4452

#4455

#4456

#4457

#4458

#446

#4460

#4461

#4462

#4463

#4465

#4466

#4468

#4469

#447

#4471

#4472

#4473

#4479

#448

#4480

#4481

#4482

#4484

#4485

#4488

#449

#4492

#4493

#4494

#4495

#4496

#4497

#4498

#4499

#45

#450

#4501

#4502

#4503

#4504

#4505

#4506

#4507

#4508

#4509

#451

#4511

#4512

#4514

#4516

#4517

#4519

#452

#4520

#4521

#4523

#4524

#4526

#4527

#4529

#453

#4531

#4532

#4533

#4535

#4536

#4538

#4539

#454

#4540

#4541

#4542

#4544

#4545

#4546

#4549

#455

#4550

#4552

#4553

#4554

#4555

#4556

#4557

#4558

#4559

#456

#4560

#4561

#4563

#4564

#4566

#4569

#457

#4570

#4571

#4572

#4574

#4575

#4576

#4577

#4579

#458

#4580

#4581

#4584

#4585

#4586

#4587

#4588

#4589

#459

#4591

#4592

#4593

#4593

#4595

#4597

#4598

#4599

#46

#460

#4600

#4601

#4602

#4603

#4604

#4606

#4608

#4609

#461

#4611

#4612

#4614

#4615

#4616

#4617

#4618

#4619

#462

#4620

#4621

#4622

#4623

#4624

#4627

#4629

#463

#4630

#4631

#4632

#4633

#4634

#4635

#4636

#4637

#464

#4640

#4641

#4642

#4645

#4646

#4647

#465

#4650

#4653

#4654

#4655

#4656

#4657

#4658

#4659

#4659

#4663

#4665

#4666

#4667

#4669

#467

#4670

#4671

#4672

#4673

#4674

#4676

#4678

#4680

#4683

#4684

#4685

#4686

#4689

#469

#4690

#4692

#4693

#4694

#4695

#4696

#4697

#4698

#4699

#47

#470

#4700

#4701

#4702

#4703

#4704

#4706

#4707

#4708

#4709

#471

#4710

#4712

#4713

#4715

#4716

#4718

#472

#4720

#4721

#4722

#4723

#4724

#4725

#4726

#4727

#4728

#4729

#473

#4730

#4731

#4732

#4733

#4734

#4735

#4736

#4738

#474

#4740

#4741

#4742

#4743

#4745

#4748

#4749

#475

#4750

#4752

#4753

#4754

#4755

#4757

#4758

#476

#4763

#4764

#4765

#4766

#4768

#477

#4770

#4771

#4772

#4773

#4774

#4775

#4777

#4778

#4779

#478

#4784

#4786

#4787

#4788

#4789

#479

#4790

#4791

#4792

#4793

#4794

#4795

#4796

#4798

#4799

#48

#480

#4800

#4801

#4802

#4804

#4805

#4807

#4808

#4809

#481

#4810

#4811

#4812

#4813

#4814

#4815

#4816

#4817

#4819

#482

#4820

#4821

#4822

#4823

#4824

#4825

#4827

#4828

#483

#4830

#4831

#4832

#4834

#4836

#4837

#4838

#484

#4840

#4841

#4842

#4843

#4846

#4849

#4849

#485

#4850

#4851

#4852

#4853

#4854

#4856

#4858

#486

#4860

#4861

#4864

#4866

#4869

#487

#4872

#4873

#4874

#4876

#4877

#4878

#488

#4883

#4884

#4886

#4887

#4889

#489

#4890

#4893

#4894

#4895

#4896

#4897

#4898

#49

#490

#4900

#4901

#4902

#4904

#4905

#4907

#4908

#4909

#491

#4910

#4911

#4914

#4915

#4916

#4917

#4918

#4919

#492

#4920

#4921

#4922

#4923

#4925

#4926

#4927

#4928

#493

#4932

#4933

#4934

#4935

#4936

#4937

#4938

#4940

#4942

#4943

#4945

#4946

#4947

#4948

#4949

#495

#4950

#4951

#4952

#4953

#4954

#4959

#496

#4963

#4965

#4966

#4967

#497

#4972

#4975

#4976

#4976

#4977

#4978

#498

#4981

#4982

#4983

#4988

#4989

#4990

#4991

#4992

#4993

#4995

#4996

#4998

#5

#50

#500

#5001

#5002

#5007

#5008

#5009

#501

#5012

#5014

#5015

#5017

#5018

#502

#5020

#5022

#5023

#5024

#5025

#503

#5031

#5032

#5033

#5035

#5036

#504

#5043

#5044

#5046

#5047

#5048

#505

#5051

#5052

#5053

#5055

#5057

#5058

#5059

#506

#5060

#5062

#5063

#5064

#5065

#5067

#5069

#507

#5070

#5071

#5072

#5073

#5074

#5076

#5077

#5078

#5079

#508

#5080

#5081

#5082

#5082

#5084

#5085

#5086

#5087

#5088

#5089

#509

#5090

#5092

#5093

#5095

#5096

#5097

#5098

#5099

#51

#510

#5100

#5102

#5103

#5105

#5106

#5107

#511

#5111

#5112

#5113

#5114

#5115

#5116

#5117

#5118

#512

#5120

#5120

#5121

#5122

#5123

#5124

#5125

#5127

#5128

#5129

#513

#5130

#5131

#5132

#5133

#5134

#5135

#5138

#514

#5140

#5141

#5143

#5146

#5147

#5148

#5149

#515

#5150

#5153

#5155

#5155

#5156

#5157

#5158

#5159

#516

#5160

#5160

#5161

#5162

#5164

#5165

#5166

#5169

#517

#5170

#5171

#5172

#5173

#5176

#5177

#5178

#518

#5181

#5183

#5186

#5189

#519

#5190

#5192

#5194

#5196

#5199

#52

#520

#5201

#5202

#5206

#5207

#5209

#521

#5210

#5214

#5216

#5217

#5219

#522

#5224

#5225

#5227

#5228

#5229

#5230

#5231

#5232

#5233

#5234

#5235

#5236

#5237

#5238

#5239

#5240

#5241

#5242

#5246

#5247

#5248

#5248

#5249

#525

#5250

#5251

#5252

#5253

#5254

#5255

#5256

#5257

#5258

#5258

#526

#5260

#5261

#5262

#5263

#5264

#5265

#5265

#5267

#5267

#5268

#5269

#527

#5270

#5272

#5273

#5274

#5275

#5276

#5277

#5278

#5279

#528

#5280

#5281

#5282

#5283

#5284

#5285

#5286

#5287

#5288

#5289

#529

#5291

#5292

#5294

#5294

#5295

#5296

#5297

#5298

#5299

#53

#530

#5301

#5302

#5303

#5304

#5306

#5307

#5308

#5309

#531

#5310

#5311

#5313

#5314

#5315

#5316

#5317

#5318

#532

#5320

#5321

#5322

#5324

#5325

#5326

#5327

#5329

#533

#5330

#5331

#5332

#5333

#5334

#5335

#5336

#5337

#5338

#5339

#5340

#5341

#5342

#5343

#5344

#5345

#5346

#5347

#5348

#5349

#535

#5350

#5351

#5352

#5353

#5354

#5355

#5356

#5357

#5358

#536

#5360

#5361

#5362

#5363

#5364

#5365

#5366

#5367

#5368

#5369

#537

#5371

#5372

#5373

#5374

#5375

#5376

#5377

#5378

#5379

#538

#5380

#5382

#5383

#5384

#5386

#5388

#5389

#539

#5390

#5392

#5395

#5396

#5398

#5399

#54

#540

#5400

#5401

#5402

#5403

#5404

#5405

#5406

#5407

#5408

#541

#5411

#5412

#5413

#5415

#5416

#5417

#5418

#542

#5420

#5422

#5423

#5424

#5425

#5427

#5428

#5429

#543

#5430

#5431

#5432

#5433

#5434

#5435

#5437

#5438

#5440

#5441

#5442

#5444

#5445

#5446

#5447

#5448

#5449

#545

#5451

#5452

#5454

#5455

#5456

#5457

#546

#5460

#5461

#5462

#5465

#5468

#5469

#547

#5470

#5471

#5472

#5473

#5476

#5477

#5477

#5479

#548

#5480

#5484

#5485

#5486

#5486

#5489

#549

#5490

#5491

#5493

#5493

#5495

#5496

#5497

#5498

#5499

#55

#5500

#5501

#5502

#5503

#5504

#5506

#5508

#551

#5510

#5511

#5512

#5514

#5515

#5517

#5518

#5519

#552

#5520

#5522

#5523

#5524

#5525

#5526

#5528

#5529

#553

#5530

#5531

#5532

#5533

#5535

#5537

#554

#5541

#5543

#5544

#5545

#5546

#5548

#555

#5550

#5551

#5552

#5554

#5556

#5557

#5558

#5559

#556

#5561

#5563

#5565

#5566

#5567

#5568

#5569

#5570

#5572

#5574

#5575

#5576

#5577

#5578

#5579

#558

#5580

#5581

#5582

#5583

#5584

#5586

#5588

#5589

#559

#5590

#5591

#5592

#5593

#5596

#5598

#5599

#5602

#5603

#5604

#5605

#5606

#5607

#5608

#5609

#561

#5610

#5611

#5612

#5613

#5614

#5619

#5620

#5621

#5622

#5623

#5624

#5625

#5626

#5627

#5628

#5629

#563

#5630

#5631

#5632

#5633

#5634

#5635

#5636

#5637

#5638

#5639

#564

#5640

#5642

#5643

#5644

#5645

#5646

#5647

#5648

#5649

#565

#5650

#5651

#5652

#5653

#5654

#5655

#5656

#5657

#5658

#5659

#566

#5660

#5660

#5661

#5663

#5665

#5666

#5668

#5668

#567

#5670

#5674

#5675

#5676

#5677

#5678

#5679

#568

#5680

#5681

#5682

#5684

#5685

#5686

#5687

#5688

#5689

#569

#5690

#5691

#5692

#5693

#5694

#5695

#5696

#5697

#5698

#5699

#57

#570

#5700

#5701

#5702

#5703

#5704

#5705

#5706

#5707

#5708

#571

#5710

#5711

#5712

#5713

#5714

#5715

#5715

#5716

#5717

#5719

#572

#5720

#5722

#5723

#5724

#5725

#5727

#573

#5730

#5731

#5733

#5734

#5735

#5736

#5737

#5738

#5739

#574

#5740

#5741

#5742

#5743

#5744

#5745

#5746

#5747

#5748

#5749

#575

#5750

#5751

#5752

#5753

#5754

#5755

#5756

#5756

#5758

#5759

#576

#5760

#5761

#5763

#5764

#5765

#5766

#5767

#5769

#577

#5770

#5771

#5772

#5774

#5775

#5776

#5777

#5779

#578

#5780

#5781

#5782

#5783

#5784

#5785

#5786

#5787

#5788

#5789

#579

#5790

#5791

#5793

#5794

#5796

#5797

#5799

#58

#580

#5800

#5801

#5802

#5803

#5804

#5806

#5807

#5808

#5809

#581

#5810

#5811

#5812

#5813

#5814

#5815

#5816

#5817

#5818

#5819

#582

#5820

#5821

#5822

#5823

#5824

#5825

#5827

#5828

#5829

#583

#5832

#5833

#5835

#5836

#5837

#5838

#5839

#584

#5840

#5842

#5843

#5844

#5845

#5846

#5847

#5848

#5849

#585

#5850

#5851

#5852

#5854

#5856

#5857

#5858

#5859

#586

#5860

#5862

#5863

#5864

#5867

#5868

#5870

#5871

#5872

#5874

#5875

#5876

#5877

#5877

#5878

#5879

#5881

#5882

#5883

#5884

#5885

#5888

#5889

#589

#5891

#5892

#5893

#5894

#5895

#5896

#5897

#5898

#5899

#59

#590

#5901

#5902

#5903

#5904

#5905

#591

#5910

#5911

#5912

#5917

#5918

#5919

#592

#5921

#5922

#5923

#5924

#5925

#5928

#593

#5931

#5932

#5934

#5936

#5938

#5939

#5939

#594

#5941

#5942

#5944

#5945

#5946

#5947

#595

#5950

#5951

#5952

#5953

#5956

#5957

#5958

#5959

#596

#5961

#5962

#5963

#5966

#5967

#5968

#597

#5970

#5973

#5975

#5976

#5977

#5978

#5979

#598

#5980

#5981

#5982

#5984

#5985

#5989

#599

#5990

#5991

#5993

#5994

#5995

#5997

#5998

#6

#60

#6000

#6001

#6002

#6003

#6004

#6005

#6006

#6007

#6008

#6009

#601

#6010

#6011

#6012

#6013

#6014

#6015

#6015

#6016

#6017

#6018

#6020

#6022

#6023

#6024

#6026

#6029

#603

#6030

#6031

#6033

#6034

#6035

#6036

#6038

#604

#6040

#6041

#6042

#6043

#6044

#6045

#6046

#6048

#6050

#6051

#6052

#6053

#6054

#6055

#6056

#6057

#6059

#6060

#6061

#6062

#6063

#6064

#6065

#6068

#6069

#607

#6070

#6071

#6072

#6073

#6073

#6074

#6075

#6077

#6078

#608

#6080

#6081

#6082

#6083

#6084

#6085

#6086

#6087

#6088

#6089

#609

#6090

#6092

#6093

#6094

#6096

#6098

#6099

#61

#610

#6100

#6104

#6106

#6107

#6109

#611

#6113

#6114

#6115

#6116

#6117

#6118

#6118

#6119

#612

#6121

#6122

#6122

#6123

#6124

#6124

#6125

#6126

#6127

#6127

#6128

#6129

#613

#6130

#6131

#6132

#6134

#6135

#6136

#6137

#6139

#614

#6140

#6141

#6142

#6143

#6144

#6145

#6146

#6147

#6148

#6149

#615

#6150

#6151

#6152

#6153

#6154

#6155

#6156

#6158

#6158

#6159

#616

#6162

#6162

#6163

#6164

#6165

#6166

#6168

#617

#6172

#6173

#6173

#6174

#6177

#6178

#6179

#6179

#618

#6181

#6181

#6183

#6184

#6185

#6186

#6187

#6188

#6189

#619

#6191

#6192

#6195

#6196

#6198

#6199

#62

#620

#6206

#6208

#621

#6210

#6213

#6214

#6218

#622

#6223

#6223

#6228

#6229

#623

#6230

#6231

#6236

#624

#6240

#6242

#6245

#6246

#6247

#625

#6250

#6251

#6252

#6254

#6255

#6257

#6258

#626

#6262

#6263

#6268

#6269

#627

#6270

#6271

#6273

#6274

#6275

#6276

#6277

#6278

#6278

#6279

#628

#6280

#6282

#6283

#6284

#6285

#6286

#6287

#6288

#6289

#629

#6290

#6291

#6292

#6293

#6294

#6295

#6296

#6297

#6298

#6299

#63

#630

#6300

#6301

#6302

#6303

#6304

#6305

#6306

#6307

#6308

#6309

#631

#6310

#6311

#6312

#6313

#6314

#6315

#6316

#6317

#6318

#6319

#632

#6320

#6321

#6322

#6323

#6324

#6325

#6326

#6327

#6328

#6329

#633

#6330

#6331

#6332

#6333

#6333

#6334

#6335

#6336

#6337

#6338

#6339

#634

#6340

#6341

#6343

#6344

#6346

#6347

#6348

#635

#6351

#6352

#6353

#6354

#6354

#6355

#6356

#6357

#636

#6360

#6361

#6362

#6363

#6364

#6366

#6368

#6368

#637

#6370

#6372

#6373

#6373

#6374

#6374

#6375

#6376

#6377

#6377

#6378

#638

#6383

#6384

#6384

#6385

#639

#6391

#6392

#6393

#6393

#6394

#6394

#6395

#6395

#6398

#6398

#64

#640

#6404

#6404

#6405

#6405

#6406

#6406

#6407

#6407

#641

#642

#645

#646

#647

#648

#649

#649

#65

#652

#655

#656

#657

#659

#66

#660

#661

#662

#664

#666

#667

#668

#67

#672

#673

#678

#679

#681

#683

#686

#687

#69

#691

#692

#694

#695

#699

#7

#70

#700

#701

#704

#705

#706

#707

#708

#71

#710

#711

#712

#715

#717

#717

#719

#72

#721

#723

#724

#725

#726

#727

#728

#729

#73

#730

#731

#732

#735

#738

#739

#74

#740

#741

#742

#743

#746

#747

#748

#749

#75

#750

#751

#752

#753

#754

#756

#758

#76

#760

#762

#763

#764

#765

#766

#769

#77

#770

#771

#772

#773

#775

#777

#779

#78

#781

#783

#784

#785

#788

#789

#79

#790

#791

#792

#793

#795

#797

#798

#799

#8

#80

#800

#801

#802

#803

#804

#805

#806

#807

#808

#809

#81

#810

#811

#812

#813

#815

#816

#818

#819

#82

#820

#821

#822

#823

#824

#825

#826

#827

#828

#829

#83

#830

#831

#832

#833

#834

#835

#837

#838

#839

#84

#840

#842

#843

#844

#845

#846

#847

#848

#849

#850

#852

#853

#854

#855

#856

#857

#858

#859

#86

#860

#861

#862

#863

#864

#865

#866

#867

#868

#869

#87

#870

#871

#872

#873

#874

#875

#876

#877

#878

#879

#88

#880

#881

#886

#887

#888

#889

#890

#893

#894

#895

#896

#897

#898

#899

#9

#90

#900

#901

#902

#903

#904

#905

#907

#909

#91

#910

#911

#912

#913

#914

#915

#916

#917

#918

#919

#92

#920

#921

#922

#923

#927

#928

#929

#93

#931

#932

#933

#934

#935

#936

#937

#938

#939

#94

#940

#941

#942

#943

#944

#945

#946

#947

#948

#949

#95

#950

#951

#952

#953

#954

#955

#956

#957

#958

#959

#96

#960

#961

#962

#963

#964

#965

#966

#967

#968

#969

#97

#970

#971

#972

#973

#974

#975

#976

#977

#978

#979

#98

#980

#981

#982

#983

#984

#986

#987

#99

#992

#997

#998

#999

v0.0.1-beta

v0.0.2

v0.1.0

v0.1.1

v0.1.10

v0.1.11rc1

v0.1.11rc2

v0.1.11rc3

v0.1.11rc4

v0.1.11rc5

v0.1.12

v0.1.13

v0.1.2

v0.1.3

v0.1.4

v0.1.5

v0.1.6

v0.1.7

v0.1.8

v0.1.9

v0.2.0

v0.2.1

v0.2.2

v0.2.3

v0.2.4

v0.2.5

v0.2.6

v0.2.7

v0.2.8

v0.3.0

v0.3.1

v0.3.2

v0.3.3

v0.3.4

v0.3.5

v0.3.6

v0.3.7

v0.3.8

v0.3.9

v0.4.0

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.4.5

v0.4.6

v0.4.7

v0.4.8

v0.4.9

v0.5.0

v0.5.1

Mono Color

• 1a5847e6d1 fix the merge wangbluo 2024-08-19 03:28:29 +00:00
• 52289e4c63 Merge branch 'fp8_merge' of https://github.com/wangbluo/ColossalAI into fp8_merge wangbluo 2024-08-19 02:27:30 +00:00
• 02636c5bef fix the merge wangbluo 2024-08-19 02:26:52 +00:00
• 81272e9d00 [pre-commit.ci] auto fixes from pre-commit.com hooks pre-commit-ci[bot] 2024-08-17 09:37:37 +00:00
• 4cf79fa275 merge wangbluo 2024-08-17 09:34:18 +00:00
• 26493b97d3 [misc] update compatibility (#6008) Hongxin Liu 2024-08-16 18:49:14 +08:00
• f5c84af0b0 [Feature] Zigzag Ring attention (#5905) Edenzzzz 2024-08-16 13:56:38 +08:00
• 0a51319113 [fp8] zero support fp8 linear. (#6006) flybird11111 2024-08-16 10:13:07 +08:00
• 3f09a6145f [fp8] add use_fp8 option for MoeHybridParallelPlugin (#6009) Wang Binluo 2024-08-16 10:12:50 +08:00
• 20722a8c93 [fp8]update reduce-scatter test (#6002) flybird11111 2024-08-15 14:40:54 +08:00
• 887d2d579b [misc] Bypass the huggingface bug to solve the mask mismatch problem (#5991) Haze188 2024-08-15 14:40:26 +08:00
• 4dd03999ec [pre-commit.ci] pre-commit autoupdate (#5995) pre-commit-ci[bot] 2024-08-15 14:40:03 +08:00
• 1a2e90dcc1 [fp8] linear perf enhancement botbw 2024-08-15 03:12:08 +00:00
• 406f984063 [plugin] add cast inputs option for zero (#6003) Hongxin Liu 2024-08-15 10:41:22 +08:00
• 88fa096d78 [fp8] update torch.compile for linear_fp8 to >= 2.4.0 (#6004) botbw 2024-08-15 10:14:42 +08:00
• 597b206001 [fp8] support asynchronous FP8 communication (#5997) flybird11111 2024-08-14 14:08:19 +08:00
• ceb1e262e7 fix sync condition (#6000) Tong Li 2024-08-14 11:22:39 +08:00
• 0978080a69 [fp8] refactor fp8 linear with compile (#5993) Hongxin Liu 2024-08-13 16:07:26 +08:00
• b2483c8e31 [fp8] support hybrid parallel plugin (#5982) Wang Binluo 2024-08-12 18:17:05 +08:00
• ed97d3a5d3 [Chat] fix readme (#5989) YeAnbang 2024-08-12 14:55:17 +08:00
• f7b4fb5f07 [pre-commit.ci] auto fixes from pre-commit.com hooks ColossalChat pre-commit-ci[bot] 2024-08-12 03:12:22 +00:00
• 2d642eea0f fix readme, tokenization fully tested root 2024-08-12 11:08:01 +08:00
• 0f70c3440d fix readme, tokenization fully tested root 2024-08-12 11:07:09 +08:00
• dccc9e14ba fix readme root 2024-08-12 11:01:44 +08:00
• f1a3a326c4 [fp8]Moe support fp8 communication (#5977) flybird11111 2024-08-09 18:26:02 +08:00
• b4d2377d4c [Hotfix] Avoid fused RMSnorm import error without apex (#5985) Edenzzzz 2024-08-09 18:17:09 +08:00
• e4aadeee20 [fp8] use torch compile (torch >= 2.3.0) (#5979) botbw 2024-08-09 15:51:06 +08:00
• 8241c0c054 [fp8] support gemini plugin (#5978) Hongxin Liu 2024-08-09 14:09:48 +08:00
• ad3fa4f49c [Hotfix] README link (#5966) Tong Li 2024-08-08 18:04:47 +08:00
• 4b9bec8176 [test ci]Feature/fp8 comm (#5981) flybird11111 2024-08-08 17:19:21 +08:00
• b480eec738 [Feature]: support FP8 communication in DDP, FSDP, Gemini (#5928) Hanks 2024-08-08 15:55:01 +08:00
• 7739629b9d fix (#5976) flybird11111 2024-08-07 18:58:39 +08:00
• ccabcf6485 [fp8] support fp8 amp for hybrid parallel plugin (#5975) Hongxin Liu 2024-08-07 18:21:08 +08:00
• 76ea16466f [fp8] add fp8 linear (#5967) Hongxin Liu 2024-08-07 15:41:49 +08:00
• 9179d4088e [Docs] clarify launch port Edenzzzz 2024-08-07 13:53:48 +08:00
• afb26de873 [fp8]support all2all fp8 (#5953) flybird11111 2024-08-06 16:58:23 +08:00
• 0c10afd372 [FP8] rebase main (#5963) flybird11111 2024-08-06 16:29:37 +08:00
• 53cb9606bd [Feature] llama shardformer fp8 support (#5938) Guangyao Zhang 2024-08-05 10:05:47 +08:00
• c297e21bea Merge pull request #5961 from ver217/feature/zeor-fp8 Hanks 2024-08-02 20:38:58 +08:00
• fe71917851 Merge pull request #5962 from hpcaitech/colossalchat YeAnbang 2024-08-02 17:32:41 +08:00
• 0b2d55c4ab Support overall loss, update KTO logging colossalchat YeAnbang 2024-08-02 06:51:38 +00:00
• 91e596d017 [test] add zero fp8 test case ver217 2024-08-02 11:28:38 +08:00
• ae486ce005 [fp8] add fp8 comm for low level zero ver217 2024-08-02 11:12:12 +08:00
• 75c963686f [lora] lora support hybrid parallel plugin (#5956) Wang Binluo 2024-08-02 10:36:58 +08:00
• 19d1510ea2 [feat] Dist Loader for Eval (#5950) Tong Li 2024-08-02 10:06:25 +08:00
• 62cdac6b7b [chore] remove redundant test case, print string & reduce test tokens botbw 2024-07-30 02:56:39 +00:00
• d1d1ab871e [moe] solve dp axis issue botbw 2024-07-26 07:32:19 +00:00
• 65daa87627 [doc] add MoeHybridParallelPlugin docstring botbw 2024-07-26 06:05:01 +00:00
• 7bedd03739 [moe] remove force_overlap_comm flag and add warning instead hxwang 2024-07-25 09:49:57 +00:00
• f7c5485ed6 [chore] docstring hxwang 2024-07-25 09:07:49 +00:00
• 7e737df5ad [misc] remove useless condition haze188 2024-07-25 08:40:53 +00:00
• 70793ce9ed [misc] fix ci failure: change default value to false in moe plugin haze188 2024-07-25 07:50:41 +00:00
• 12d043ca00 [misc] remove incompatible test config haze188 2024-07-25 06:40:54 +00:00
• 606b0891ed [chore] change moe_pg_mesh to private hxwang 2024-07-25 06:34:22 +00:00
• 5b4c12381b Revert "[moe] implement submesh initialization" hxwang 2024-07-25 06:32:02 +00:00
• cb01c0d5ce [moe] refactor mesh assignment hxwang 2024-07-25 06:19:54 +00:00
• 034020bd04 [misc] remove debug/print code haze188 2024-07-24 03:10:57 +00:00
• 59bcf56c60 [misc] skip redunant test haze188 2024-07-24 02:59:35 +00:00
• c3dc9b4dba [deepseek] replace attn (a workaround for bug in transformers) hxwang 2024-07-23 12:56:58 +00:00
• 6c39f0b144 [test] add check hxwang 2024-07-23 09:38:05 +00:00
• b2952a5982 [moe] deepseek moe sp support haze188 2024-07-23 06:39:49 +00:00
• 96d0fbc531 [bug] fix: somehow logger hangs the program botbw 2024-07-23 06:17:51 +00:00
• 067e18f7e9 [test] fix test: test_zero1_2 hxwang 2024-07-22 05:36:20 +00:00
• 74b03de3f9 [moe] remove ops hxwang 2024-07-22 04:00:42 +00:00
• 70c9924d0d [chore] solve moe ckpt test failure and some other arg pass failure hxwang 2024-07-22 03:40:34 +00:00
• 52d346f2a5 [pre-commit.ci] auto fixes from pre-commit.com hooks pre-commit-ci[bot] 2024-07-19 07:54:40 +00:00
• 46037c2ccd [chore] minor fix after rebase hxwang 2024-07-19 07:53:40 +00:00
• 803878b2fd [moe] full test for deepseek and mixtral (pp + sp to fix) hxwang 2024-07-19 06:11:11 +00:00
• 7077d38d5a [moe] finalize test (no pp) hxwang 2024-07-18 13:36:18 +00:00
• 2cddeac717 moe sp + ep bug fix haze188 2024-07-18 10:08:06 +00:00
• 877d94bb8c [moe] init moe plugin comm setting with sp hxwang 2024-07-18 08:37:06 +00:00
• 09d6280d3e [chore] minor fix hxwang 2024-07-18 03:53:51 +00:00
• 404b16faf3 [Feature] MoE Ulysses Support (#5918) Haze188 2024-07-18 11:37:56 +08:00
• 3e2b6132b7 [moe] clean legacy code hxwang 2024-07-16 09:08:31 +00:00
• 74eccac0db [moe] test deepseek hxwang 2024-07-16 10:10:40 +00:00
• dc583aa576 [moe] implement tp botbw 2024-07-16 06:03:57 +00:00
• 0b5bbe9ce4 [test] add mixtral modelling test botbw 2024-07-15 06:43:27 +00:00
• 102b784a10 [chore] arg pass & remove drop token hxwang 2024-07-12 09:08:16 +00:00
• 8dbb86899d [chore] trivial fix botbw 2024-07-12 07:04:17 +00:00
• 014faf6c5a [chore] manually revert unintended commit botbw 2024-07-12 03:29:16 +00:00
• 9b9b76bdcd [moe] add mixtral dp grad scaling when not all experts are activated botbw 2024-07-12 03:27:20 +00:00
• e28e05345b [moe] implement submesh initialization botbw 2024-07-11 05:50:20 +00:00
• 5ed5e8cfba solve hang when parallel mode = pp + dp haze188 2024-07-11 02:12:44 +00:00
• fe24789eb1 [misc] solve booster hang by rename the variable haze188 2024-07-09 09:44:04 +00:00
• 13b48ac0aa [zero] solve hang botbw 2024-07-09 08:14:00 +00:00
• b5bfeb2efd [moe] implement transit between non moe tp and ep botbw 2024-07-08 09:59:46 +00:00
• 37443cc7e4 [test] pass mixtral shardformer test botbw 2024-07-08 05:13:49 +00:00
• 46c069b0db [zero] solve hang hxwang 2024-07-05 07:19:37 +00:00
• 0fad23c691 [chore] handle non member group hxwang 2024-07-05 07:03:45 +00:00
• a249e71946 [test] mixtra pp shard test hxwang 2024-07-04 06:39:01 +00:00
• 8ae8525bdf [moe] fix plugin hxwang 2024-07-02 09:09:00 +00:00
• 0b76b57cd6 [test] add mixtral transformer test hxwang 2024-07-02 09:08:41 +00:00
• f9b6fcf81f [test] add mixtral for sequence classification hxwang 2024-07-02 09:02:21 +00:00
• 1aeb5e8847 [hotfix] Remove unused plan section (#5957) Tong Li 2024-07-31 17:47:46 +08:00
• 66fbf2ecb7 Update README.md (#5958) YeAnbang 2024-07-31 17:44:09 +08:00
• 30f4e31a33 [Chat] Fix lora (#5946) YeAnbang 2024-07-31 14:10:17 +08:00
• 09c5f72595 [release] update version (#5952) v0.4.2 Hongxin Liu 2024-07-31 10:04:50 +08:00
• 060892162a [zero] hotfix update master params (#5951) Hongxin Liu 2024-07-30 13:36:00 +08:00
• bcf0181ecd [Feat] Distrifusion Acceleration Support for Diffusion Inference (#5895) Runyu Lu 2024-07-30 10:43:26 +08:00
• 7b38964e3a [shardformer] hotfix attn mask (#5947) Hongxin Liu 2024-07-29 19:10:06 +08:00