Commit Graph

Select branches

Hide Pull Requests

ColossalChat

ckpt_api

cloud/coati

colossalchat

colossalchat_upgrade

dev/gpt2_metainfo_patch

dev/zero-offload

develop

feat/agpo

feat/boxed-version

feat/grpo

feat/hybrid_model_sync

feat/online-serving

feat/ppo

feat/speculative-decoding

feature/2-stage

feature/async-io

feature/colossal-infer

feature/dist-ckp-io

feature/dualpipe

feature/elixir

feature/inference-refactor

feature/lora

feature/ray-rlhf

feature/stable-diffusion

feature/zerobubble

fix-setup

flybird11111-patch-1

grpo-agentic-dev

grpo-code

grpo-dev

grpo-latest

grpo-latest-ascend

grpo-latest-dev

grpo-latest-dev-debug

grpo-latest-dev-reward-update

grpo-latest-rebase-main

grpo-latest-revert

grpo-latest-support-entropy-metric

grpo-latest-v3

grpo-profile

grpo-reward-dev

grpo-support-multi-machine

grpo-zero-bubble

grpo-zero-bubble-rebase

grpo_optimization

hotfix/example_test

hotfix/kernel_build_before_load

hotfix/tp-issue

hpc-ai-cloud

main

moe_sp

pre-commit-ci-update-config

refactor/inference

release/v0.5.0

revert-6292-grpo-latest-dev-reward-update

supercooledith-patch-1

support-npu

upgrade_transformers

uxsqN94oMfWTUNCA

#10

#100

#1000

#1001

#1003

#1004

#1005

#1007

#1008

#1009

#101

#1010

#1011

#1012

#1015

#1016

#1017

#1018

#1019

#1020

#1021

#1022

#1024

#1025

#1026

#1027

#1029

#1030

#1031

#1034

#1040

#1041

#1042

#1044

#1045

#1046

#1047

#1048

#1049

#1050

#1052

#1053

#1054

#1059

#1062

#1063

#1066

#1068

#1069

#1070

#1071

#1072

#1073

#1075

#1076

#1077

#1078

#108

#1080

#1081

#1086

#1087

#1088

#1089

#1090

#1091

#1093

#1094

#1096

#1097

#1098

#1099

#11

#1100

#1101

#1102

#1103

#1105

#1106

#1108

#111

#1115

#1117

#1118

#1119

#112

#1120

#1121

#1122

#1123

#1125

#1127

#1128

#1129

#113

#1130

#1131

#1133

#1134

#1135

#1136

#1137

#1138

#1139

#114

#1140

#1142

#1143

#1144

#1145

#1146

#1147

#1148

#115

#1150

#1151

#1152

#1153

#1154

#1155

#1156

#1157

#1158

#1159

#1160

#1161

#1163

#1164

#1165

#1166

#1167

#1168

#1169

#1170

#1171

#1172

#1173

#1174

#1175

#1176

#1177

#1178

#1179

#118

#1181

#1182

#1185

#1186

#1187

#1188

#1189

#1191

#1192

#1193

#1194

#1196

#1197

#1198

#1199

#12

#1200

#1201

#1202

#1203

#1204

#1207

#1208

#1209

#1210

#1211

#1212

#1213

#1214

#1215

#1216

#1217

#1219

#1220

#1221

#1222

#1223

#1224

#1225

#1226

#1227

#1228

#1229

#123

#1230

#1231

#1232

#1233

#1234

#1235

#1236

#1237

#1238

#1239

#1240

#1241

#1242

#1243

#1244

#1245

#1246

#1247

#1248

#1248

#125

#1250

#1251

#1252

#1253

#1254

#1255

#1256

#1257

#1258

#1259

#126

#1260

#1261

#1262

#1263

#1264

#1265

#1266

#1267

#1268

#1269

#127

#1270

#1271

#1272

#1273

#1274

#1275

#1276

#1277

#1278

#1279

#128

#1280

#1281

#1282

#1283

#1284

#1285

#1286

#1287

#1288

#1288

#1289

#129

#1290

#1291

#1292

#1293

#1294

#1295

#1296

#1297

#1298

#1299

#13

#130

#1300

#1301

#1302

#1303

#1305

#1306

#1307

#1308

#1309

#1310

#1311

#1312

#1313

#1314

#1315

#1316

#1318

#1319

#132

#1320

#1321

#1323

#1324

#1325

#1326

#1327

#1328

#1329

#133

#1331

#1332

#1333

#1334

#1335

#1336

#1338

#1339

#1340

#1342

#1343

#1344

#1345

#1346

#1347

#1348

#1349

#135

#1350

#1351

#1352

#1353

#1354

#1355

#1357

#1358

#1359

#1360

#1361

#1362

#1363

#1364

#1366

#1367

#1368

#1369

#137

#1370

#1372

#1373

#1374

#1376

#1377

#1378

#1379

#138

#1380

#1381

#1382

#1383

#1384

#1385

#1386

#1387

#1388

#1391

#1392

#1393

#1394

#1395

#1396

#1397

#1398

#1399

#14

#140

#1403

#1404

#1405

#1406

#1407

#1408

#1409

#141

#1410

#1415

#1416

#1417

#1418

#1419

#142

#1421

#1422

#1423

#1424

#1425

#1426

#1428

#1429

#143

#1430

#1431

#1432

#1433

#1435

#1436

#1437

#1438

#1439

#144

#1441

#1442

#1444

#1446

#1447

#1448

#1449

#145

#1450

#1451

#1452

#1453

#1456

#1457

#1458

#1459

#146

#1460

#1461

#1462

#1463

#1464

#1465

#1466

#1467

#1468

#1469

#147

#1470

#1471

#1472

#1473

#1475

#1476

#1477

#1478

#1479

#148

#1480

#1481

#1482

#1483

#1484

#1486

#1487

#1488

#1489

#1490

#1492

#1493

#1494

#1495

#1496

#1497

#1499

#15

#1500

#1501

#1502

#1503

#1504

#1505

#1506

#1507

#1508

#1509

#151

#1510

#1511

#1512

#1513

#1514

#1515

#1516

#1518

#1519

#152

#1520

#1521

#1522

#1523

#1524

#1525

#1526

#1527

#1528

#1529

#153

#1530

#1531

#1532

#1533

#1534

#1535

#1536

#1537

#1538

#1539

#154

#1541

#1542

#1543

#1544

#1545

#1546

#1547

#1548

#1549

#1550

#1551

#1552

#1553

#1554

#1555

#1556

#1557

#1558

#1559

#156

#1560

#1561

#1562

#1563

#1564

#1565

#1566

#1567

#1568

#1569

#157

#1570

#1571

#1572

#1573

#1574

#1575

#1576

#1578

#1581

#1583

#1584

#1585

#1586

#1587

#1588

#1589

#159

#1590

#1591

#1594

#1595

#1596

#1597

#1598

#1599

#160

#1600

#1601

#1602

#1603

#1604

#1605

#1606

#1607

#1608

#1609

#161

#1610

#1611

#1612

#1613

#1614

#1615

#1616

#1617

#1618

#1619

#162

#1620

#1621

#1622

#1623

#1624

#1625

#1628

#1629

#163

#1630

#1631

#1633

#1634

#1635

#1636

#1637

#1638

#1639

#164

#1640

#1641

#1642

#1643

#1644

#1645

#1646

#1647

#1648

#1649

#165

#1650

#1651

#1652

#1653

#1654

#1655

#1656

#1657

#1658

#1659

#166

#1660

#1661

#1662

#1663

#1664

#1665

#1666

#1667

#1669

#167

#1670

#1671

#1673

#1674

#1676

#1677

#1678

#1679

#168

#1680

#1681

#1682

#1683

#1684

#1686

#1687

#1688

#1689

#1690

#1691

#1692

#1694

#1695

#1696

#1697

#1698

#1699

#17

#1700

#1701

#1702

#1703

#1704

#1705

#1706

#1707

#1708

#1709

#171

#1710

#1711

#1712

#1713

#1714

#1715

#1716

#1717

#1718

#1719

#172

#1720

#1721

#1722

#1723

#1724

#1725

#1726

#1727

#1728

#1729

#173

#1730

#1731

#1732

#1733

#1734

#1735

#1736

#1739

#174

#1740

#1741

#1742

#1743

#1744

#1745

#1746

#1747

#1748

#1750

#1751

#1752

#1753

#1754

#1755

#1757

#1758

#1759

#176

#1760

#1762

#1763

#1764

#1765

#1766

#1767

#1768

#1769

#1770

#1771

#1772

#1775

#1776

#1778

#178

#1780

#1781

#1782

#1783

#1784

#1785

#1786

#1787

#1788

#1789

#179

#1790

#1791

#1792

#1793

#1796

#1797

#1798

#1799

#18

#1800

#1801

#1802

#1803

#1804

#1805

#1806

#1807

#1808

#1809

#1810

#1811

#1812

#1813

#1814

#1815

#1816

#1817

#1818

#1819

#1820

#1821

#1822

#1823

#1824

#1825

#1826

#1827

#1828

#1829

#183

#1830

#1831

#1832

#1833

#1834

#1835

#1836

#1837

#184

#1840

#1842

#1843

#1844

#1845

#1846

#1847

#1848

#1849

#1851

#1852

#1853

#1854

#1855

#1856

#1857

#1858

#1859

#186

#1860

#1865

#1866

#1867

#1868

#1869

#187

#1871

#1873

#1874

#1875

#1876

#1877

#1878

#1879

#188

#1880

#1889

#189

#1891

#1893

#1894

#1895

#1896

#1897

#1898

#1899

#19

#190

#1901

#1902

#1903

#1904

#1905

#1906

#1907

#1908

#1909

#191

#1910

#1916

#1917

#1918

#1919

#192

#1920

#1921

#1922

#1924

#1925

#1927

#1928

#193

#1930

#1931

#1937

#1938

#1939

#194

#1940

#1941

#1942

#1943

#1944

#1946

#1950

#1950

#1952

#1953

#1954

#1955

#1957

#1958

#1959

#196

#1960

#1961

#1962

#1963

#1964

#1967

#1968

#197

#1970

#1971

#1972

#1973

#1974

#1977

#1978

#1979

#198

#1980

#1981

#1982

#1984

#1985

#1986

#1987

#1989

#1990

#1998

#1999

#2

#20

#200

#2000

#2001

#2002

#2003

#2004

#2005

#2006

#2007

#2008

#2009

#201

#2010

#2011

#2015

#2016

#2017

#2018

#2019

#202

#2020

#2021

#2021

#2022

#2023

#2025

#2027

#2028

#2029

#203

#2030

#2032

#2033

#2034

#2035

#2036

#2037

#2038

#2039

#204

#2040

#2042

#2043

#2045

#2046

#2047

#2048

#205

#2050

#2051

#2052

#2053

#2058

#2059

#2060

#2061

#2062

#2064

#2065

#2066

#2069

#2071

#2072

#2073

#2074

#2075

#2076

#2077

#2078

#2079

#2080

#2081

#2082

#2083

#2084

#2085

#2086

#2087

#2088

#2089

#209

#2090

#2091

#2092

#2095

#2096

#2097

#2098

#2099

#21

#210

#2101

#2102

#2103

#2104

#2105

#2106

#2107

#2108

#2110

#2111

#2112

#2113

#2115

#2116

#2117

#2118

#2119

#212

#2120

#2123

#2124

#2125

#2126

#2127

#2128

#2129

#213

#2130

#2131

#2132

#2133

#2134

#2136

#2137

#2138

#2139

#214

#2144

#2146

#2147

#2148

#2149

#215

#2150

#2151

#2152

#2153

#2154

#2155

#2156

#2157

#2158

#2159

#2162

#2163

#2164

#2165

#2167

#2168

#2168

#2169

#217

#2171

#2172

#2173

#2174

#2175

#2177

#2178

#2179

#218

#2184

#2186

#2187

#2188

#2189

#219

#2190

#2191

#2193

#2194

#2195

#2196

#2197

#220

#2200

#2201

#2202

#2203

#2206

#2207

#2208

#2209

#221

#2210

#2211

#2212

#2213

#2214

#2216

#2217

#2219

#222

#2221

#2222

#2223

#2224

#2225

#2226

#2227

#2228

#2229

#223

#2231

#2232

#2234

#2237

#2238

#2239

#224

#2242

#2243

#2244

#2245

#2247

#2248

#2254

#2257

#2258

#226

#2261

#2262

#2263

#2264

#2265

#2266

#2267

#2268

#2268

#2269

#227

#2270

#2271

#2272

#2273

#2274

#2275

#2276

#2277

#2278

#2279

#2280

#2281

#2282

#2283

#2284

#2286

#2287

#2288

#2289

#229

#2290

#2291

#2292

#2293

#2295

#2296

#2297

#2298

#2299

#23

#2300

#2301

#2302

#2303

#2304

#2305

#2306

#2307

#2308

#2310

#2311

#2312

#2313

#2314

#2315

#2316

#2317

#2318

#2319

#232

#2320

#2322

#2323

#2326

#2327

#2328

#2329

#233

#2333

#2336

#2338

#2339

#2340

#2342

#2344

#2345

#2348

#2349

#2350

#2352

#2353

#2354

#2355

#2356

#2357

#2358

#2359

#2363

#2364

#2365

#2366

#2367

#2368

#2370

#2371

#2372

#2373

#2374

#2375

#2379

#2381

#2385

#2387

#2389

#2390

#2393

#2395

#2396

#2396

#2397

#2399

#24

#240

#2400

#2401

#2403

#2404

#2405

#2406

#2408

#2410

#2411

#2412

#2413

#2414

#2415

#2416

#2417

#2418

#2419

#242

#2420

#2423

#2424

#2427

#243

#2431

#2432

#2434

#2436

#2438

#244

#2442

#2443

#2444

#2445

#2446

#2448

#2449

#245

#2451

#2452

#2453

#2456

#2459

#246

#2463

#2464

#2465

#2466

#2468

#2469

#2471

#2473

#2474

#2475

#2476

#2477

#248

#2481

#2482

#2483

#2484

#2485

#2486

#2488

#249

#2492

#2494

#2495

#2497

#2498

#2499

#25

#2502

#2503

#2504

#2506

#2507

#2508

#2509

#251

#2510

#2511

#2512

#2514

#2515

#2516

#2517

#2518

#2519

#252

#2520

#2521

#2522

#2523

#2524

#2525

#2526

#2527

#2528

#2529

#253

#2532

#2533

#2534

#2537

#2538

#2540

#2543

#2544

#2545

#2549

#255

#2550

#2552

#2554

#2556

#2558

#2560

#2561

#2564

#2565

#2567

#2568

#2572

#2574

#2577

#2578

#2581

#2584

#2585

#2586

#2589

#2591

#2594

#2596

#2598

#2600

#2601

#2602

#2604

#2607

#2608

#2611

#2613

#2614

#2615

#2618

#2619

#2621

#2623

#2624

#2625

#2626

#263

#2635

#2637

#264

#2641

#2643

#2644

#2647

#2648

#265

#2652

#2656

#2657

#2658

#2659

#266

#2661

#2664

#2665

#2666

#2669

#267

#2670

#2671

#2672

#2674

#2675

#2678

#268

#2680

#2681

#2683

#2686

#2687

#2689

#2689

#269

#2690

#2691

#2692

#2693

#2694

#2695

#2696

#2698

#2699

#27

#270

#2700

#2701

#2701

#2702

#2702

#2703

#2704

#2705

#2706

#2707

#2708

#2709

#271

#2711

#2712

#2713

#2714

#2715

#2716

#2717

#2719

#272

#2720

#2721

#2723

#2725

#2726

#2727

#2728

#273

#2730

#2734

#2736

#2737

#2738

#274

#2740

#2741

#2742

#2744

#2747

#2749

#2749

#275

#2754

#276

#2760

#2762

#2764

#2766

#2767

#2769

#277

#2773

#2775

#2777

#2789

#279

#2791

#2792

#2796

#2797

#2798

#28

#280

#2803

#2804

#281

#2812

#2813

#2817

#282

#2820

#2821

#2822

#2823

#2824

#2826

#2829

#283

#2835

#2837

#284

#2846

#2848

#2849

#285

#2852

#2854

#286

#2860

#2863

#2867

#2869

#287

#2871

#2876

#288

#2880

#2886

#2895

#29

#291

#2912

#2914

#292

#2920

#2922

#2923

#2925

#2927

#2929

#293

#2930

#2932

#2933

#2935

#2939

#294

#2944

#2946

#2951

#2954

#296

#2964

#2966

#2969

#297

#2971

#2974

#2977

#298

#2982

#2983

#2984

#2986

#2987

#2988

#299

#2993

#2994

#2996

#2997

#2999

#3

#30

#300

#3006

#3008

#301

#3014

#3017

#3019

#302

#3020

#3022

#3025

#3026

#3028

#3029

#303

#3032

#3034

#3037

#304

#3042

#305

#3055

#3056

#3057

#3058

#306

#3062

#3065

#307

#3070

#3072

#3073

#3075

#3079

#308

#3080

#3082

#3084

#3085

#3086

#3087

#3089

#309

#3093

#3094

#3098

#3099

#310

#3101

#3104

#3105

#3107

#3108

#311

#3113

#3116

#312

#3121

#3122

#3128

#3129

#313

#3131

#3132

#3133

#3135

#3136

#3138

#3139

#3147

#315

#3151

#3153

#3154

#3157

#3159

#316

#3162

#3166

#3167

#317

#3170

#3173

#3174

#3177

#3178

#3180

#3181

#3183

#3185

#3186

#3188

#3190

#3191

#3194

#3195

#3197

#3199

#32

#320

#3204

#3205

#3206

#3207

#3209

#321

#3211

#3213

#3216

#3218

#3219

#322

#3221

#3222

#3223

#3225

#3227

#3229

#323

#3230

#3232

#3233

#3236

#3238

#3239

#324

#3241

#3244

#325

#3253

#3254

#3255

#3256

#3257

#3259

#3260

#3261

#3262

#3263

#3265

#3266

#3268

#3269

#327

#3270

#3272

#3273

#3274

#3275

#3276

#3277

#3279

#328

#3282

#3283

#3284

#3285

#3286

#3287

#3288

#3289

#329

#3290

#3292

#3293

#3294

#3295

#3296

#3297

#3298

#3299

#33

#330

#3300

#3301

#3302

#3304

#3305

#3306

#3307

#3308

#3309

#331

#3311

#3312

#3313

#3315

#3318

#332

#3323

#3327

#3329

#333

#3332

#3333

#3338

#334

#3343

#3346

#3347

#335

#3352

#3354

#336

#3367

#3368

#337

#3377

#3378

#3379

#338

#3384

#3386

#339

#3398

#34

#340

#3405

#3408

#341

#3411

#3417

#3418

#342

#3420

#3424

#3427

#3429

#343

#3431

#3433

#3436

#344

#3442

#3445

#3448

#345

#3450

#3452

#3453

#346

#3461

#3465

#347

#3472

#3473

#3474

#3475

#3476

#3477

#3479

#348

#3481

#3486

#3488

#349

#3493

#3497

#35

#350

#3504

#3506

#351

#3513

#3516

#3517

#3519

#352

#3520

#3522

#3525

#353

#3536

#354

#3541

#3548

#3549

#355

#3551

#3552

#3553

#3557

#356

#3561

#3563

#3567

#3567

#3568

#357

#3572

#3573

#3577

#3578

#3579

#358

#3581

#3586

#3588

#3589

#359

#3590

#3592

#3593

#3594

#3596

#3597

#36

#360

#3603

#3605

#3608

#361

#3610

#3611

#3612

#3618

#3619

#362

#3621

#3623

#3625

#3627

#3628

#363

#3632

#364

#3641

#3645

#3646

#3647

#3648

#365

#3652

#3653

#3654

#3655

#3656

#366

#3662

#3663

#3666

#3667

#3668

#367

#3671

#3679

#368

#3680

#3684

#3688

#369

#3691

#3692

#3693

#3694

#3695

#3697

#3699

#3699

#370

#3706

#3707

#3709

#371

#3710

#3711

#3713

#3715

#3718

#3719

#372

#3722

#3725

#3727

#3728

#3729

#373

#3730

#3731

#3735

#374

#3740

#3742

#3744

#3748

#375

#3751

#3754

#3756

#3758

#3759

#376

#3763

#3765

#3767

#377

#3770

#3771

#3772

#3774

#3775

#3778

#3779

#378

#3780

#3781

#3782

#3783

#3785

#3786

#3787

#3788

#3789

#379

#3792

#3794

#3795

#3799

#38

#380

#3801

#3804

#3805

#3806

#3807

#3808

#3809

#381

#3810

#3813

#3815

#3816

#3817

#382

#3820

#3821

#3822

#3823

#3824

#3825

#3826

#3827

#3828

#3829

#383

#3830

#3831

#3833

#3834

#3835

#3838

#384

#3841

#3842

#3844

#3845

#3846

#3847

#3849

#385

#3850

#3855

#3856

#386

#3860

#3862

#3864

#3865

#3868

#3869

#387

#3871

#3872

#3873

#3877

#3878

#3879

#388

#3880

#3882

#3883

#3884

#3885

#3887

#389

#3890

#3891

#3896

#3898

#3899

#39

#390

#3900

#3901

#3902

#3905

#3907

#3908

#3909

#391

#3910

#3911

#3913

#3915

#3916

#3917

#3918

#3919

#392

#3920

#3922

#3923

#3924

#3925

#3926

#3928

#3929

#393

#3930

#3931

#3932

#3934

#3936

#3937

#3939

#394

#3940

#3942

#3943

#3944

#3946

#3947

#3949

#395

#3956

#3960

#3963

#3967

#3968

#3969

#397

#3970

#3972

#3976

#3976

#3979

#3980

#3984

#3985

#3987

#3988

#399

#3990

#3991

#3993

#3994

#3996

#3999

#4

#40

#400

#4001

#4002

#4004

#4006

#4006

#401

#4011

#4013

#4014

#4016

#4018

#4019

#402

#4020

#4021

#4022

#4024

#4025

#4026

#4028

#403

#4030

#4033

#4034

#4036

#4039

#404

#4041

#4043

#4045

#4046

#4046

#4047

#4048

#4049

#4053

#4055

#4056

#4058

#406

#4060

#4062

#4064

#4065

#4067

#4068

#4068

#4069

#407

#4070

#4072

#4073

#4075

#4079

#4080

#4081

#4082

#4083

#4086

#4087

#4089

#409

#4090

#4091

#4093

#4094

#4096

#4098

#41

#410

#4100

#4101

#4103

#4105

#4106

#4107

#4109

#411

#4111

#4112

#4115

#4117

#412

#4122

#4124

#4126

#4127

#4129

#413

#4130

#4132

#4137

#4138

#4139

#414

#4141

#4142

#4144

#4145

#4146

#4147

#4149

#4152

#4153

#4155

#4157

#4158

#4159

#416

#4160

#4161

#4162

#4163

#4165

#4166

#4167

#4169

#417

#4171

#4172

#4173

#4174

#4175

#4176

#4178

#4179

#418

#4180

#4182

#4185

#4187

#4188

#419

#4191

#4192

#4194

#4196

#4197

#42

#420

#4202

#4203

#4205

#4206

#4208

#421

#4210

#4212

#4213

#4214

#4215

#4216

#4217

#4218

#422

#4221

#4223

#4224

#4225

#4226

#4227

#4228

#4229

#423

#423

#4231

#4233

#4234

#4236

#4237

#4238

#4239

#424

#4240

#4241

#4243

#4244

#4245

#4246

#4248

#4250

#4251

#4252

#4253

#4254

#4255

#4256

#4257

#4258

#4259

#426

#4260

#4261

#4263

#4264

#4265

#4266

#4267

#4268

#4269

#427

#4270

#4271

#4272

#4273

#4274

#4275

#4276

#4277

#4278

#4279

#428

#4283

#4284

#4287

#4288

#429

#4290

#4291

#4293

#4295

#4297

#4299

#43

#430

#4300

#4301

#4302

#4303

#4305

#4306

#4307

#4309

#4309

#431

#4310

#4312

#4313

#4314

#4315

#4316

#4317

#432

#4320

#4321

#4323

#4324

#4325

#4329

#433

#4330

#4331

#4332

#4333

#4334

#4336

#4338

#434

#4340

#4341

#4345

#4346

#4347

#4349

#435

#4350

#4352

#4354

#4355

#4356

#4357

#4358

#4359

#436

#4362

#4363

#4366

#4369

#4372

#4377

#4379

#438

#4380

#4382

#4384

#4386

#4388

#4389

#439

#4392

#4395

#4396

#4398

#4399

#44

#440

#4401

#4403

#4404

#4405

#4407

#4408

#4409

#441

#4413

#4415

#4416

#442

#4420

#4421

#4423

#4424

#4426

#4426

#4428

#4429

#4430

#4431

#4432

#4433

#4434

#4435

#4436

#4440

#4441

#4443

#4445

#4446

#4448

#445

#4450

#4452

#4455

#4456

#4457

#4458

#446

#4460

#4461

#4462

#4463

#4465

#4466

#4468

#4469

#447

#4471

#4472

#4473

#4479

#448

#4480

#4481

#4482

#4484

#4485

#4488

#449

#4492

#4493

#4494

#4495

#4496

#4497

#4498

#4499

#45

#450

#4501

#4502

#4503

#4504

#4505

#4506

#4507

#4508

#4509

#451

#4511

#4512

#4514

#4516

#4517

#4519

#452

#4520

#4521

#4523

#4524

#4526

#4527

#4529

#453

#4531

#4532

#4533

#4535

#4536

#4538

#4539

#454

#4540

#4541

#4542

#4544

#4545

#4546

#4549

#455

#4550

#4552

#4553

#4554

#4555

#4556

#4557

#4558

#4559

#456

#4560

#4561

#4563

#4564

#4566

#4569

#457

#4570

#4571

#4572

#4574

#4575

#4576

#4577

#4579

#458

#4580

#4581

#4584

#4585

#4586

#4587

#4588

#4589

#459

#4591

#4592

#4593

#4593

#4595

#4597

#4598

#4599

#46

#460

#4600

#4601

#4602

#4603

#4604

#4606

#4608

#4609

#461

#4611

#4612

#4614

#4615

#4616

#4617

#4618

#4619

#462

#4620

#4621

#4622

#4623

#4624

#4627

#4629

#463

#4630

#4631

#4632

#4633

#4634

#4635

#4636

#4637

#464

#4640

#4641

#4642

#4645

#4646

#4647

#465

#4650

#4653

#4654

#4655

#4656

#4657

#4658

#4659

#4659

#4663

#4665

#4666

#4667

#4669

#467

#4670

#4671

#4672

#4673

#4674

#4676

#4678

#4680

#4683

#4684

#4685

#4686

#4689

#469

#4690

#4692

#4693

#4694

#4695

#4696

#4697

#4698

#4699

#47

#470

#4700

#4701

#4702

#4703

#4704

#4706

#4707

#4708

#4709

#471

#4710

#4712

#4713

#4715

#4716

#4718

#472

#4720

#4721

#4722

#4723

#4724

#4725

#4726

#4727

#4728

#4729

#473

#4730

#4731

#4732

#4733

#4734

#4735

#4736

#4738

#474

#4740

#4741

#4742

#4743

#4745

#4748

#4749

#475

#4750

#4752

#4753

#4754

#4755

#4757

#4758

#476

#4763

#4764

#4765

#4766

#4768

#477

#4770

#4771

#4772

#4773

#4774

#4775

#4777

#4778

#4779

#478

#4784

#4786

#4787

#4788

#4789

#479

#4790

#4791

#4792

#4793

#4794

#4795

#4796

#4798

#4799

#48

#480

#4800

#4801

#4802

#4804

#4805

#4807

#4808

#4809

#481

#4810

#4811

#4812

#4813

#4814

#4815

#4816

#4817

#4819

#482

#4820

#4821

#4822

#4823

#4824

#4825

#4827

#4828

#483

#4830

#4831

#4832

#4834

#4836

#4837

#4838

#484

#4840

#4841

#4842

#4843

#4846

#4849

#4849

#485

#4850

#4851

#4852

#4853

#4854

#4856

#4858

#486

#4860

#4861

#4864

#4866

#4869

#487

#4872

#4873

#4874

#4876

#4877

#4878

#488

#4883

#4884

#4886

#4887

#4889

#489

#4890

#4893

#4894

#4895

#4896

#4897

#4898

#49

#490

#4900

#4901

#4902

#4904

#4905

#4907

#4908

#4909

#491

#4910

#4911

#4914

#4915

#4916

#4917

#4918

#4919

#492

#4920

#4921

#4922

#4923

#4925

#4926

#4927

#4928

#493

#4932

#4933

#4934

#4935

#4936

#4937

#4938

#4940

#4942

#4943

#4945

#4946

#4947

#4948

#4949

#495

#4950

#4951

#4952

#4953

#4954

#4959

#496

#4963

#4965

#4966

#4967

#497

#4972

#4975

#4976

#4976

#4977

#4978

#498

#4981

#4982

#4983

#4988

#4989

#4990

#4991

#4992

#4993

#4995

#4996

#4998

#5

#50

#500

#5001

#5002

#5007

#5008

#5009

#501

#5012

#5014

#5015

#5017

#5018

#502

#5020

#5022

#5023

#5024

#5025

#503

#5031

#5032

#5033

#5035

#5036

#504

#5043

#5044

#5046

#5047

#5048

#505

#5051

#5052

#5053

#5055

#5057

#5058

#5059

#506

#5060

#5062

#5063

#5064

#5065

#5067

#5069

#507

#5070

#5071

#5072

#5073

#5074

#5076

#5077

#5078

#5079

#508

#5080

#5081

#5082

#5082

#5084

#5085

#5086

#5087

#5088

#5089

#509

#5090

#5092

#5093

#5095

#5096

#5097

#5098

#5099

#51

#510

#5100

#5102

#5103

#5105

#5106

#5107

#511

#5111

#5112

#5113

#5114

#5115

#5116

#5117

#5118

#512

#5120

#5120

#5121

#5122

#5123

#5124

#5125

#5127

#5128

#5129

#513

#5130

#5131

#5132

#5133

#5134

#5135

#5138

#514

#5140

#5141

#5143

#5146

#5147

#5148

#5149

#515

#5150

#5153

#5155

#5155

#5156

#5157

#5158

#5159

#516

#5160

#5160

#5161

#5162

#5164

#5165

#5166

#5169

#517

#5170

#5171

#5172

#5173

#5176

#5177

#5178

#518

#5181

#5183

#5186

#5189

#519

#5190

#5192

#5194

#5196

#5199

#52

#520

#5201

#5202

#5206

#5207

#5209

#521

#5210

#5214

#5216

#5217

#5219

#522

#5224

#5225

#5227

#5228

#5229

#5230

#5231

#5232

#5233

#5234

#5235

#5236

#5237

#5238

#5239

#5240

#5241

#5242

#5246

#5247

#5248

#5248

#5249

#525

#5250

#5251

#5252

#5253

#5254

#5255

#5256

#5257

#5258

#5258

#526

#5260

#5261

#5262

#5263

#5264

#5265

#5265

#5267

#5267

#5268

#5269

#527

#5270

#5272

#5273

#5274

#5275

#5276

#5277

#5278

#5279

#528

#5280

#5281

#5282

#5283

#5284

#5285

#5286

#5287

#5288

#5289

#529

#5291

#5292

#5294

#5294

#5295

#5296

#5297

#5298

#5299

#53

#530

#5301

#5302

#5303

#5304

#5306

#5307

#5308

#5309

#531

#5310

#5311

#5313

#5314

#5315

#5316

#5317

#5318

#532

#5320

#5321

#5322

#5324

#5325

#5326

#5327

#5329

#533

#5330

#5331

#5332

#5333

#5334

#5335

#5336

#5337

#5338

#5339

#5340

#5341

#5342

#5343

#5344

#5345

#5346

#5347

#5348

#5349

#535

#5350

#5351

#5352

#5353

#5354

#5355

#5356

#5357

#5358

#536

#5360

#5361

#5362

#5363

#5364

#5365

#5366

#5367

#5368

#5369

#537

#5371

#5372

#5373

#5374

#5375

#5376

#5377

#5378

#5379

#538

#5380

#5382

#5383

#5384

#5386

#5388

#5389

#539

#5390

#5392

#5395

#5396

#5398

#5399

#54

#540

#5400

#5401

#5402

#5403

#5404

#5405

#5406

#5407

#5408

#541

#5411

#5412

#5413

#5415

#5416

#5417

#5418

#542

#5420

#5422

#5423

#5424

#5425

#5427

#5428

#5429

#543

#5430

#5431

#5432

#5433

#5434

#5435

#5437

#5438

#5440

#5441

#5442

#5444

#5445

#5446

#5447

#5448

#5449

#545

#5451

#5452

#5454

#5455

#5456

#5457

#546

#5460

#5461

#5462

#5465

#5468

#5469

#547

#5470

#5471

#5472

#5473

#5476

#5477

#5477

#5479

#548

#5480

#5484

#5485

#5486

#5486

#5489

#549

#5490

#5491

#5493

#5493

#5495

#5496

#5497

#5498

#5499

#55

#5500

#5501

#5502

#5503

#5504

#5506

#5508

#551

#5510

#5511

#5512

#5514

#5515

#5517

#5518

#5519

#552

#5520

#5522

#5523

#5524

#5525

#5526

#5528

#5529

#553

#5530

#5531

#5532

#5533

#5535

#5537

#554

#5541

#5543

#5544

#5545

#5546

#5548

#555

#5550

#5551

#5552

#5554

#5556

#5557

#5558

#5559

#556

#5561

#5563

#5565

#5566

#5567

#5568

#5569

#5570

#5572

#5574

#5575

#5576

#5577

#5578

#5579

#558

#5580

#5581

#5582

#5583

#5584

#5586

#5588

#5589

#559

#5590

#5591

#5592

#5593

#5596

#5598

#5599

#5602

#5603

#5604

#5605

#5606

#5607

#5608

#5609

#561

#5610

#5611

#5612

#5613

#5614

#5619

#5620

#5621

#5622

#5623

#5624

#5625

#5626

#5627

#5628

#5629

#563

#5630

#5631

#5632

#5633

#5634

#5635

#5636

#5637

#5638

#5639

#564

#5640

#5642

#5643

#5644

#5645

#5646

#5647

#5648

#5649

#565

#5650

#5651

#5652

#5653

#5654

#5655

#5656

#5657

#5658

#5659

#566

#5660

#5660

#5661

#5663

#5665

#5666

#5668

#5668

#567

#5670

#5674

#5675

#5676

#5677

#5678

#5679

#568

#5680

#5681

#5682

#5684

#5685

#5686

#5687

#5688

#5689

#569

#5690

#5691

#5692

#5693

#5694

#5695

#5696

#5697

#5698

#5699

#57

#570

#5700

#5701

#5702

#5703

#5704

#5705

#5706

#5707

#5708

#571

#5710

#5711

#5712

#5713

#5714

#5715

#5715

#5716

#5717

#5719

#572

#5720

#5722

#5723

#5724

#5725

#5727

#573

#5730

#5731

#5733

#5734

#5735

#5736

#5737

#5738

#5739

#574

#5740

#5741

#5742

#5743

#5744

#5745

#5746

#5747

#5748

#5749

#575

#5750

#5751

#5752

#5753

#5754

#5755

#5756

#5756

#5758

#5759

#576

#5760

#5761

#5763

#5764

#5765

#5766

#5767

#5769

#577

#5770

#5771

#5772

#5774

#5775

#5776

#5777

#5779

#578

#5780

#5781

#5782

#5783

#5784

#5785

#5786

#5787

#5788

#5789

#579

#5790

#5791

#5793

#5794

#5796

#5797

#5799

#58

#580

#5800

#5801

#5802

#5803

#5804

#5806

#5807

#5808

#5809

#581

#5810

#5811

#5812

#5813

#5814

#5815

#5816

#5817

#5818

#5819

#582

#5820

#5821

#5822

#5823

#5824

#5825

#5827

#5828

#5829

#583

#5832

#5833

#5835

#5836

#5837

#5838

#5839

#584

#5840

#5842

#5843

#5844

#5845

#5846

#5847

#5848

#5849

#585

#5850

#5851

#5852

#5854

#5856

#5857

#5858

#5859

#586

#5860

#5862

#5863

#5864

#5867

#5868

#5870

#5871

#5872

#5874

#5875

#5876

#5877

#5877

#5878

#5879

#5881

#5882

#5883

#5884

#5885

#5888

#5889

#589

#5891

#5892

#5893

#5894

#5895

#5896

#5897

#5898

#5899

#59

#590

#5901

#5902

#5903

#5904

#5905

#591

#5910

#5911

#5912

#5917

#5918

#5919

#592

#5921

#5922

#5923

#5924

#5925

#5928

#593

#5931

#5932

#5934

#5936

#5938

#5939

#5939

#594

#5941

#5942

#5944

#5945

#5946

#5947

#595

#5950

#5951

#5952

#5953

#5956

#5957

#5958

#5959

#596

#5961

#5962

#5963

#5966

#5967

#5968

#597

#5970

#5973

#5975

#5976

#5977

#5978

#5979

#598

#5980

#5981

#5982

#5984

#5985

#5989

#599

#5990

#5991

#5993

#5994

#5995

#5997

#5998

#6

#60

#6000

#6001

#6002

#6003

#6004

#6005

#6006

#6007

#6008

#6009

#601

#6010

#6011

#6012

#6013

#6014

#6015

#6015

#6016

#6017

#6018

#6020

#6022

#6023

#6024

#6026

#6029

#603

#6030

#6031

#6033

#6034

#6035

#6036

#6038

#604

#6040

#6041

#6042

#6043

#6044

#6045

#6046

#6048

#6050

#6051

#6052

#6053

#6054

#6055

#6056

#6057

#6059

#6060

#6061

#6062

#6063

#6064

#6065

#6068

#6069

#607

#6070

#6071

#6072

#6073

#6073

#6074

#6075

#6077

#6078

#608

#6080

#6081

#6082

#6083

#6084

#6085

#6086

#6087

#6088

#6089

#609

#6090

#6092

#6093

#6094

#6096

#6098

#6099

#61

#610

#6100

#6104

#6106

#6107

#6109

#611

#6113

#6114

#6115

#6116

#6117

#6118

#6118

#6119

#612

#6121

#6122

#6122

#6123

#6124

#6124

#6125

#6126

#6127

#6127

#6128

#6129

#613

#6130

#6131

#6132

#6134

#6135

#6136

#6137

#6139

#614

#6140

#6141

#6142

#6143

#6144

#6145

#6146

#6147

#6148

#6149

#615

#6150

#6151

#6152

#6153

#6154

#6155

#6156

#6158

#6158

#6159

#616

#6162

#6162

#6163

#6164

#6165

#6166

#6168

#617

#6172

#6173

#6173

#6174

#6177

#6178

#6179

#6179

#618

#6181

#6181

#6183

#6184

#6185

#6186

#6187

#6188

#6189

#619

#6191

#6192

#6195

#6196

#6198

#6199

#62

#620

#6206

#6208

#621

#6210

#6213

#6214

#6218

#622

#6223

#6223

#6228

#6229

#623

#6230

#6231

#6236

#624

#6240

#6242

#6245

#6246

#6247

#625

#6250

#6251

#6252

#6254

#6255

#6257

#6258

#626

#6262

#6263

#6268

#6269

#627

#6270

#6271

#6273

#6274

#6275

#6276

#6277

#6278

#6278

#6279

#628

#6280

#6282

#6283

#6284

#6285

#6286

#6287

#6288

#6289

#629

#6290

#6291

#6292

#6293

#6294

#6295

#6296

#6297

#6298

#6299

#63

#630

#6300

#6301

#6302

#6303

#6304

#6305

#6306

#6307

#6308

#6309

#631

#6310

#6311

#6312

#6313

#6314

#6315

#6316

#6317

#6318

#6319

#632

#6320

#6321

#6322

#6323

#6324

#6325

#6326

#6327

#6328

#6329

#633

#6330

#6331

#6332

#6333

#6333

#6334

#6335

#6336

#6337

#6338

#6339

#634

#6340

#6341

#6343

#6344

#6346

#6347

#6348

#635

#6351

#6352

#6353

#6354

#6354

#6355

#6356

#6357

#636

#6360

#6361

#6362

#6363

#6364

#6366

#6368

#6368

#637

#6370

#6372

#6373

#6373

#6374

#6374

#6375

#6376

#6377

#6377

#6378

#638

#6383

#6384

#6384

#6385

#639

#6391

#6392

#6393

#6393

#6394

#6394

#6395

#6395

#6398

#6398

#64

#640

#6404

#6404

#6405

#6405

#6406

#6406

#6407

#6407

#641

#642

#645

#646

#647

#648

#649

#649

#65

#652

#655

#656

#657

#659

#66

#660

#661

#662

#664

#666

#667

#668

#67

#672

#673

#678

#679

#681

#683

#686

#687

#69

#691

#692

#694

#695

#699

#7

#70

#700

#701

#704

#705

#706

#707

#708

#71

#710

#711

#712

#715

#717

#717

#719

#72

#721

#723

#724

#725

#726

#727

#728

#729

#73

#730

#731

#732

#735

#738

#739

#74

#740

#741

#742

#743

#746

#747

#748

#749

#75

#750

#751

#752

#753

#754

#756

#758

#76

#760

#762

#763

#764

#765

#766

#769

#77

#770

#771

#772

#773

#775

#777

#779

#78

#781

#783

#784

#785

#788

#789

#79

#790

#791

#792

#793

#795

#797

#798

#799

#8

#80

#800

#801

#802

#803

#804

#805

#806

#807

#808

#809

#81

#810

#811

#812

#813

#815

#816

#818

#819

#82

#820

#821

#822

#823

#824

#825

#826

#827

#828

#829

#83

#830

#831

#832

#833

#834

#835

#837

#838

#839

#84

#840

#842

#843

#844

#845

#846

#847

#848

#849

#850

#852

#853

#854

#855

#856

#857

#858

#859

#86

#860

#861

#862

#863

#864

#865

#866

#867

#868

#869

#87

#870

#871

#872

#873

#874

#875

#876

#877

#878

#879

#88

#880

#881

#886

#887

#888

#889

#890

#893

#894

#895

#896

#897

#898

#899

#9

#90

#900

#901

#902

#903

#904

#905

#907

#909

#91

#910

#911

#912

#913

#914

#915

#916

#917

#918

#919

#92

#920

#921

#922

#923

#927

#928

#929

#93

#931

#932

#933

#934

#935

#936

#937

#938

#939

#94

#940

#941

#942

#943

#944

#945

#946

#947

#948

#949

#95

#950

#951

#952

#953

#954

#955

#956

#957

#958

#959

#96

#960

#961

#962

#963

#964

#965

#966

#967

#968

#969

#97

#970

#971

#972

#973

#974

#975

#976

#977

#978

#979

#98

#980

#981

#982

#983

#984

#986

#987

#99

#992

#997

#998

#999

v0.0.1-beta

v0.0.2

v0.1.0

v0.1.1

v0.1.10

v0.1.11rc1

v0.1.11rc2

v0.1.11rc3

v0.1.11rc4

v0.1.11rc5

v0.1.12

v0.1.13

v0.1.2

v0.1.3

v0.1.4

v0.1.5

v0.1.6

v0.1.7

v0.1.8

v0.1.9

v0.2.0

v0.2.1

v0.2.2

v0.2.3

v0.2.4

v0.2.5

v0.2.6

v0.2.7

v0.2.8

v0.3.0

v0.3.1

v0.3.2

v0.3.3

v0.3.4

v0.3.5

v0.3.6

v0.3.7

v0.3.8

v0.3.9

v0.4.0

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.4.5

v0.4.6

v0.4.7

v0.4.8

v0.4.9

v0.5.0

v0.5.1

Mono Color

• 62c13e7969 [Ring Attention] Improve comments (#6085) Wenxuan Tan 2024-10-15 22:23:35 -05:00
• 90939b77e0 [fix] debug zbv llama test; duanjunwen 2024-10-15 09:39:11 +00:00
• dcd41d0973 Merge pull request #6071 from wangbluo/ring_attention Wang Binluo 2024-10-15 15:17:21 +08:00
• 83cf2f84fb fix wangbluo 2024-10-15 14:50:27 +08:00
• 52dcc73313 Merge branch 'feature/zerobubble' of github.com:hpcaitech/ColossalAI into dev/zero_bubble duanjunwen 2024-10-15 06:31:45 +00:00
• 9912cc8c07 [fix] fix bwd b; now bwd w only for Layer replaced by Linear1D_Col/Row; other layer perform a fully bwd; duanjunwen 2024-10-15 06:26:01 +00:00
• bc7eeade33 fix wangbluo 2024-10-15 13:28:33 +08:00
• fd92789af2 fix wangbluo 2024-10-15 13:26:44 +08:00
• 6be9862aaf fix wangbluo 2024-10-15 11:56:49 +08:00
• 3dc08c8a5a fix wangbluo 2024-10-15 11:01:34 +08:00
• 8ff7d0c780 fix wangbluo 2024-10-14 18:16:03 +08:00
• fe9208feac fix wangbluo 2024-10-14 18:07:56 +08:00
• 3201377e94 fix wangbluo 2024-10-14 18:06:24 +08:00
• 23199e34cc fix wangbluo 2024-10-14 18:01:53 +08:00
• 160e9a4175 [feat]EPMixtralSparseMoeBlock (op in MOE) support zbv; duanjunwen 2024-10-14 08:22:51 +00:00
• abd455189d [fix] fix test case; moe error in second iter duanjunwen 2024-10-14 07:38:02 +00:00
• a11b4b50a7 [feat] support use_zbv in llama, mixtral modeling; only replace Linear1D_Col/Row policy; duanjunwen 2024-10-14 07:12:14 +00:00
• cfade4c36d [feat] Linear1D_COL/ROW support zbv WeightGradStore; duanjunwen 2024-10-14 07:02:43 +00:00
• d891e50617 fix wangbluo 2024-10-14 14:56:05 +08:00
• e1e86f9f1f fix wangbluo 2024-10-14 11:45:35 +08:00
• 4c8e85ee0d [Coati] Train DPO using PP (#6054) Tong Li 2024-10-11 19:32:00 +08:00
• 703bb5c18d fix the test wangbluo 2024-10-11 17:34:20 +08:00
• 4e0e99bb6a fix the test wangbluo 2024-10-11 17:31:40 +08:00
• 0ca16d5cbe [fix] fix llama, mixtral benchmark zbv loss none bug; update mixtral & llama policy and modeling; duanjunwen 2024-10-11 07:32:43 +00:00
• 1507a7528f fix wangbluo 2024-10-11 06:20:34 +00:00
• 0002ae5956 fix wangbluo 2024-10-11 14:16:21 +08:00
• dac0e07b13 [zero bubble] support zero (#6080) flybird11111 2024-10-11 14:14:05 +08:00
• dc2cdaf3e8 [shardformer] optimize seq parallelism (#6086) Hongxin Liu 2024-10-11 13:44:40 +08:00
• efe3042bb2 fix wangbluo 2024-10-10 18:38:47 +08:00
• 6b2c506fc5 Update README.md (#6087) 梁爽 2024-10-10 17:02:49 +08:00
• bcbd311bc3 Update README.md supercooledith-patch-1 梁爽 2024-10-10 16:52:55 +08:00
• 5ecc27e150 fix wangbluo 2024-10-10 15:35:52 +08:00
• f98384aef6 fix wangbluo 2024-10-10 15:17:06 +08:00
• e234dfa236 [feat] support MixtralPipelineForwards--> mixtral_for_causal_lm_forward for zbv duanjunwen 2024-10-10 06:57:35 +00:00
• 646b3c5a90 [shardformer] fix linear 1d row and support uneven splits for fused qkv linear (#6084) Hongxin Liu 2024-10-10 14:34:45 +08:00
• 72b507a7be [feat] update MixtralPipelineForwards --> mixtral_model_forward; support zbv; duanjunwen 2024-10-10 06:19:51 +00:00
• 9ee80fc828 [fix] MixtralForCausalLMPolicy get_held_layer support zbv; duanjunwen 2024-10-10 05:40:22 +00:00
• b635dd0669 fix wangbluo 2024-10-09 14:05:26 +08:00
• 3f5bec8dc4 [feat] support zbv in mixtral benchmark; duanjunwen 2024-10-09 03:58:01 +00:00
• 3532f77b90 fix wangbluo 2024-10-09 10:57:19 +08:00
• 531773ff54 Merge pull request #6077 from duanjunwen/dev/zero_bubble duanjunwen 2024-10-09 10:22:14 +08:00
• cc500b3e25 [fix] fix mixtral policy; duanjunwen 2024-10-08 09:34:09 +00:00
• 292a504bea [fix] fix mixtral policy; duanjunwen 2024-10-08 09:25:11 +00:00
• f4d023ca6e Merge branch 'feature/zerobubble' of github.com:hpcaitech/ColossalAI into dev/zero_bubble duanjunwen 2024-10-08 08:13:17 +00:00
• 295dd2d9fe [zerobubble] rebase main (#6075) flybird11111 2024-10-08 15:58:00 +08:00
• 6975c50f78 [fix] fix build ci; duanjunwen 2024-09-30 02:34:54 +00:00
• 5c8bbf63a8 [feat] update optimizer bwd; ä¸ duanjunwen 2024-09-29 09:59:41 +00:00
• d63479553c [feat] zerobubble support moehybridplugin; duanjunwen 2024-09-29 08:33:55 +00:00
• af6aa9ed06 [plugin] hybrid support zero bubble pipeline (#6060) flybird11111 2024-09-27 14:48:55 +08:00
• b804fdc297 Merge pull request #6069 from duanjunwen/dev/zero_bubble duanjunwen 2024-09-27 10:34:04 +08:00
• 1342a983b1 [fix] rm print & comments; duanjunwen 2024-09-26 11:05:27 +00:00
• 64ceea746f [fix] remove chunk 0 stage 0 bwd b; u don't have to cal micrbatch's dx; duanjunwen 2024-09-26 10:50:44 +00:00
• 3fab92166e fix wangbluo 2024-09-26 18:03:09 +08:00
• bb0390c90d [fix] remove duplicate arg; rm comments; duanjunwen 2024-09-26 09:45:44 +00:00
• c5503b0d80 [fix] fix test_pipeline_utils ci; duanjunwen 2024-09-26 07:18:16 +00:00
• 45f17fc6cc [fix] rm comments; duanjunwen 2024-09-26 06:13:56 +00:00
• a92e16719b [fix] fix zerobubble; support shardformer model type; duanjunwen 2024-09-26 06:11:56 +00:00
• f4daf04270 add funding news (#6072) binmakeswell 2024-09-26 12:29:27 +08:00
• 6705dad41b fix wangbluo 2024-09-25 19:02:21 +08:00
• 91ed32c256 fix wangbluo 2024-09-25 19:00:38 +08:00
• 6fb1322db1 fix wangbluo 2024-09-25 18:56:18 +08:00
• 65c8297710 fix the attn wangbluo 2024-09-25 18:51:03 +08:00
• cfd9eda628 fix the ring attn wangbluo 2024-09-25 18:34:29 +08:00
• 83163fa70c [fix] fix traverse; traverse dict --> traverse tensor List; duanjunwen 2024-09-25 06:38:11 +00:00
• fc8b016887 [fix] fix stage_indices; duanjunwen 2024-09-25 06:15:45 +00:00
• cbaa104216 release FP8 news (#6068) binmakeswell 2024-09-25 11:57:16 +08:00
• 8501202a35 Merge pull request #6065 from duanjunwen/dev/zero_bubble duanjunwen 2024-09-24 19:17:37 +08:00
• 7e6f793c51 [fix] fix detach_output_obj clone; duanjunwen 2024-09-24 08:08:32 +00:00
• 6c1e1550ae [fix] fix dumb clone; duanjunwen 2024-09-23 06:43:49 +00:00
• a875212a42 [fix] fix ci --> oom in 4096 hidden dim; duanjunwen 2024-09-23 05:55:16 +00:00
• c114d1429a [fix] fix detach clone release order; duanjunwen 2024-09-23 04:00:24 +00:00
• da3220f48c [fix] fix pipeline util func deallocate --> release_tensor_data; fix bwd_b loss bwd branch; duanjunwen 2024-09-20 09:48:35 +00:00
• 1739df423c [fix] fix fwd branch, fwd pass both micro_batch & internal_inputs' duanjunwen 2024-09-20 07:34:43 +00:00
• b6616f544e [fix] rm comments; duanjunwen 2024-09-20 07:29:41 +00:00
• c6d6ee39bd [fix] use tree_flatten replace dict traverse; duanjunwen 2024-09-20 07:18:49 +00:00
• 26783776f1 [fix] fix input_tensors buffer append input_obj(dict) --> Tuple (microbatch, input_obj) , and all bwd b related cal logic; duanjunwen 2024-09-20 06:41:19 +00:00
• 4753bf7add [fix] fix mem assert; duanjunwen 2024-09-19 08:27:47 +00:00
• a115106f8d [fix] fix bwd w input; duanjunwen 2024-09-19 08:10:05 +00:00
• 349272c71f [fix] updatw bwd b&w input; dict --> list[torch.Tensor] duanjunwen 2024-09-19 07:47:01 +00:00
• 6ee9584b9a [fix] fix require_grad & deallocate call; duanjunwen 2024-09-19 05:53:03 +00:00
• 1f5c7258aa Merge remote-tracking branch 'upstream/feature/zerobubble' into dev/zero_bubble duanjunwen 2024-09-19 03:52:13 +00:00
• dabc2e7430 [release] update version (#6062) v0.4.4 Hongxin Liu 2024-09-19 10:45:32 +08:00
• f9546ba0be [ColossalEval] support for vllm (#6056) Camille Zhong 2024-09-18 17:09:45 +08:00
• af2c2f8092 [feat] add more test; duanjunwen 2024-09-18 07:51:54 +00:00
• 3dbad102cf [fix] fix zerobubble pp for shardformer type input; duanjunwen 2024-09-18 07:14:34 +00:00
• 4fa6b9509c [moe] add parallel strategy for shared_expert && fix test for deepseek (#6063) botbw 2024-09-18 10:09:01 +08:00
• 63314ce4e4 Merge pull request #6064 from wangbluo/fix_attn Wang Binluo 2024-09-18 10:08:15 +08:00
• 10e4f7da72 fix wangbluo 2024-09-16 13:45:04 +08:00
• 37e35230ff Merge pull request #6061 from wangbluo/sp_fix Wang Binluo 2024-09-14 20:54:35 +08:00
• 827ef3ee9a fix wangbluo 2024-09-14 10:40:35 +00:00
• bdb125f83f [doc] FP8 training and communication document (#6050) Guangyao Zhang 2024-09-14 11:01:05 +08:00
• f20b066c59 [fp8] Disable all_gather intranode. Disable Redundant all_gather fp8 (#6059) Guangyao Zhang 2024-09-14 10:40:01 +08:00
• b582319273 fix wangbluo 2024-09-13 10:24:41 +00:00
• 0ad3129cb9 fix wangbluo 2024-09-13 09:01:26 +00:00
• 0b14a5512e fix wangbluo 2024-09-13 07:06:14 +00:00
• 696fced0d7 [fp8] fix missing fp8_comm flag in mixtral (#6057) botbw 2024-09-13 14:30:05 +08:00
• dc032172c3 fix wangbluo 2024-09-13 06:00:58 +00:00
• f393867cff fix wangbluo 2024-09-13 05:24:52 +00:00
• 6eb8832366 fix wangbluo 2024-09-13 05:06:56 +00:00
• 683179cefd fix wangbluo 2024-09-13 03:40:56 +00:00