Commit Graph

Select branches

Hide Pull Requests

1.x

dev

doc-ja

doc-zh

master

portable

#1040

#1044

#1071

#1104

#1194

#1195

#1199

#12

#1203

#1226

#1252

#1259

#1286

#1312

#1313

#132

#132

#134

#134

#1346

#1360

#1365

#139

#14

#1426

#1428

#1438

#1439

#1497

#1541

#1543

#1556

#1579

#1579

#1591

#1593

#1595

#1595

#1596

#1608

#1637

#1638

#1639

#1640

#1656

#1674

#1675

#1681

#1682

#1684

#1699

#171

#1715

#1716

#1775

#1779

#1786

#1795

#1805

#1817

#1835

#1853

#1858

#1861

#1869

#1879

#1889

#1889

#1892

#1892

#1898

#1899

#1922

#1931

#1957

#1957

#1961

#20

#20

#213

#219

#254

#254

#262

#268

#278

#291

#297

#327

#35

#36

#39

#39

#40

#41

#463

#47

#47

#48

#482

#490

#490

#508

#509

#524

#524

#532

#534

#534

#535

#535

#547

#548

#559

#560

#569

#569

#573

#578

#589

#592

#597

#608

#623

#624

#634

#634

#637

#637

#641

#647

#728

#728

#77

#78

#782

#788

#788

#79

#793

#793

#80

#801

#81

#811

#819

#827

#83

#837

#840

#840

#841

#845

#850

#86

#861

#861

#88

#938

#938

#941

#945

#945

#954

v1.0.0

v1.1.0

v1.1.1

v1.1.2

v1.1.3

v1.1.4

v1.1.5

v1.2.0

v1.2.1

v1.2.10

v1.2.11

v1.2.2

v1.2.3

v1.2.4

v1.2.5

v1.2.6

v1.2.7

v1.2.8

v1.2.9

v1.3.0

v1.3.1

v1.3.2

v1.3.3

v1.3.4

v1.3.5

v1.4.0

v1.5.0

v1.5.1

v1.5.2

v1.5.3

v1.5.4

v1.6.0

v1.6.1

v1.6.2

v1.6.3

v1.6.4

v1.6.5

v1.6.6

v1.6.7

v1.6.8

v1.7.0

v1.7.1

v1.7.2

v1.7.3

v1.7.4

v1.7.5

v1.7.6

v1.7.7

v1.7.8

v1.8.0

v1.8.1

v1.8.2

v1.8.3

v1.8.4

v1.8.5

v1.8.6

v2.0.0-alpha.0

v2.1.0

v2.1.0-alpha.0

v2.1.0-beta.0

v2.1.0-beta.62

v2.1.1

Mono Color

• 10f88481ec Golang support xxj 2021-03-27 08:27:47 -04:00
• 74abcbf849 Revise documentation hankcs 2021-03-08 16:54:47 -05:00
• 6b60684f44 修复 CustomDictionary.reload() fix https://github.com/hankcs/HanLP/issues/1635 hankcs 2021-03-23 11:00:11 -04:00
• 9e3e8c45ba Portable同步升级到v1.8.1 hankcs 2021-03-19 17:02:46 -04:00
• 80cc0fdde0 Merge branch '1.x' into portable hankcs 2021-03-19 17:02:14 -04:00
• 4704cc17bd :checkered_flag:常规维护与修复；小版本+1，发布v1.8.1 v1.8.1 hankcs 2021-03-19 17:01:07 -04:00
• 18e5c7a1ae 修复 convertToPinyinList fix https://github.com/hankcs/HanLP/issues/1634 hankcs 2021-03-19 16:57:29 -04:00
• 88d3eb057b 提问请上论坛：https://bbs.hanlp.com/ hankcs 2021-03-10 10:21:38 -05:00
• 5d06dd007e Fix the underscore in param name of RESTful Java client hankcs 2021-03-10 01:22:40 -05:00
• 103a305f47 Revise documentation hankcs 2021-03-08 16:54:47 -05:00
• c31d7c5c33 Validate dataset before __len__ hankcs 2021-03-07 22:52:10 -05:00
• 01903096b2 Highlight CPU hankcs 2021-03-07 08:33:55 -05:00
• 0c09649a63 Remove bad zip file on exception hankcs 2021-03-06 19:17:36 -05:00
• 38a182fa22 Call to_tuple for the newer version of transformers hankcs 2021-03-05 19:54:29 -05:00
• d6b1b99e18 CountdownTimer use stdout to match with logger hankcs 2021-03-05 15:17:47 -05:00
• 669650f919 Fallback to torch.cuda when nvml is not available hankcs 2021-03-05 13:29:53 -05:00
• 48c87df646 Move penman to extra package hankcs 2021-03-05 12:56:08 -05:00
• 92aa3507b3 Flash message defaults to stderr hankcs 2021-03-05 12:49:54 -05:00
• d8449897ca Support for multithreading download and resume on error hankcs 2021-03-04 22:38:11 -05:00
• 10f13da544 Relax error check to accommodate Korean tokenization hankcs 2021-03-04 00:53:28 -05:00
• 9724417298 Implement Vocab3D hankcs 2021-03-01 04:59:25 -05:00
• d31c58b0c5 Implement LowerCase3D hankcs 2021-03-01 04:53:34 -05:00
• db7e182b6d Refactor PadSequenceDataLoader, make a new static method hankcs 2021-03-01 04:51:47 -05:00
• a2be63e740 Add a utility function split_dict hankcs 2021-03-01 04:49:44 -05:00
• 7c191ef8ef TorchComponent handles non-standard dataset better hankcs 2021-03-01 04:49:04 -05:00
• 94c9167ed6 Improve NER gazetteer matching rules hankcs 2021-02-28 14:32:18 -05:00
• f9928b4661 Revise documentation hankcs 2021-02-28 13:01:39 -05:00
• 201efeb0b2 Replace the broken MT5 model, fix https://github.com/hankcs/HanLP/issues/1624 hankcs 2021-02-28 12:38:56 -05:00
• 72f3e26256 sentencepiece is essential for Transformer fast tokenizer hankcs 2021-02-28 11:46:30 -05:00
• d24f1f7372 Improve T5 tokenization of leading spaces hankcs 2021-02-28 00:30:39 -05:00
• a961ec2f35 More specific type hints hankcs 2021-02-27 23:56:48 -05:00
• 5a8b71e78c Revise documentation hankcs 2021-02-27 14:10:11 -05:00
• a3265d8a28 Fix duplicate subwords in BERT tokenization hankcs 2021-02-27 14:02:34 -05:00
• 251bbab078 KerasComponent supports finetuning now: https://bbs.hankcs.com/t/topic/3457 hankcs 2021-02-27 13:19:49 -05:00
• 53bc1002bc Revise documentation hankcs 2021-02-25 21:27:22 -05:00
• 37adbacc8b Fix edge case of empty sentence constituency parsing, fix https://github.com/hankcs/HanLP/issues/1622 hankcs 2021-02-25 11:25:26 -05:00
• 801b08bfad No shuffling in TensorFlow dependency prediction, fix https://github.com/hankcs/HanLP/issues/1621 hankcs 2021-02-24 23:42:40 -05:00
• eae7cc604c Disable BERT logging for Jupyter Notebook and Windows hankcs 2021-02-24 12:04:07 -05:00
• a1db48ce0c Test small close model with multithreading as it's more powerful hankcs 2021-02-22 12:59:57 -05:00
• 171bd2df65 Fix NVMLError_Uninitialized on macOS fix https://github.com/hankcs/HanLP/issues/1616#issuecomment-783547545 hankcs 2021-02-22 12:49:47 -05:00
• 68d063a294 修复CharTable 归一化部分字符错误 fix https://github.com/hankcs/HanLP/issues/1615 hankcs 2021-02-22 12:43:27 -05:00
• e7ff463bf4 Fix dtype in RelativeSinusoidalPositionalEmbedding fix https://github.com/hankcs/HanLP/issues/1616 hankcs 2021-02-22 12:22:50 -05:00
• 8e703cbed3 Support using export CUDA_VISIBLE_DEVICES= to disable GPUs hankcs 2021-02-19 23:21:32 -05:00
• d843cb7d03 Revise documentation hankcs 2021-02-13 15:48:49 -05:00
• 68b87d44ca Fix delta in combining tokens for TransformerTaggingTokenizer hankcs 2021-02-13 02:23:36 -05:00
• 5012148b02 Allow consecutive entities with the same type to be merged hankcs 2021-02-12 17:51:29 -05:00
• 8c280ab807 Robust sub-word tokenization of control characters hankcs 2021-02-11 17:40:12 -05:00
• 4d14a076c9 Portable同步升级到v1.8.0 hankcs 2021-02-11 12:05:07 -05:00
• 49bc6c22cb Merge branch '1.x' into portable hankcs 2021-02-11 12:02:54 -05:00
• 673bfd17fa Fix delta in combining tokens for TransformerTaggingTokenizer hankcs 2021-02-10 23:06:04 -05:00
• 4a51ce83a4 Fix bug in combining tokens for TransformerTaggingTokenizer hankcs 2021-02-10 21:00:34 -05:00
• 3778f74236 Support resolved_tasks when tasks are resolved hankcs 2021-02-10 19:36:40 -05:00
• be861af9fc Revise documentation hankcs 2021-02-08 12:32:10 -05:00
• 31a37fd5e7 Prefix match doc key in to_conll hankcs 2021-02-08 10:25:27 -05:00
• 937309a6f9 Revise documentation hankcs 2021-02-05 12:52:33 -05:00
• b3562d9846 :checkered_flag:支持多实例、补充字符集；中版本+1，发布v1.8.0 v1.8.0 hankcs 2021-02-05 20:56:00 -05:00
• 8cf8ee6dd3 Also del config.task_names for __delitem__ of MTL hankcs 2021-02-05 11:41:12 -05:00
• 39b2dd40ad Also del config for __delitem__ of MTL hankcs 2021-01-30 18:37:35 -05:00
• b340fbbb46 Revise documentation hankcs 2021-02-04 22:38:28 -05:00
• 723e11ab9c Demo for del tasks from MTL https://bbs.hankcs.com/t/topic/3354 hankcs 2021-02-03 13:35:10 -05:00
• 9ee3e28b31 Bump version of hanlp_common hankcs 2021-01-30 01:13:50 -05:00
• 6c844a33e0 Revise documentation hankcs 2021-01-22 21:06:04 -05:00
• aff3f3a12e 重构CustomDictionary，支持多实例 https://github.com/hankcs/HanLP/issues/1339 hankcs 2021-01-30 23:14:52 -05:00
• b9a899b1f5 支持𩽾𩾌(ān kāng)之类的补充字符集 fix https://github.com/hankcs/HanLP/issues/1564 hankcs 2021-01-30 22:56:31 -05:00
• 2ab077001c Rename con to constituency in docs hankcs 2021-01-21 22:51:30 -05:00
• ae5dbf06ba Fix visualization of constituency tree with multiple sub-trees connecting to root hankcs 2021-01-20 21:37:17 -05:00
• bfd4530890 Fix lemma rules fix https://bbs.hankcs.com/t/hanlp2-1-hanlp-pretrained-mtl-ud-ontonotes-tok-pos-lem-fea-ner-srl-dep-sdp-con-xlmr-base/3285 hankcs 2021-01-20 10:24:47 -05:00
• ba42d17c7e Revise documentation hankcs 2021-01-14 01:20:33 -05:00
• 25774261d4 修复 CoreStopWordDictionary.dictionary.clear() fix https://github.com/hankcs/HanLP/issues/1603 hankcs 2021-01-16 13:18:59 -05:00
• 6265aecc56 双数组trie树防止传入空白key导致无法转移状态 fix https://bbs.hankcs.com/t/dat/3196/8 hankcs 2021-01-15 12:58:20 -05:00
• 1843062fa2 Avoid creating empty TrieDict hankcs 2021-01-14 01:20:33 -05:00
• c6840eb3da Release new mtl-mul model hankcs 2021-01-14 01:11:43 -05:00
• 5ccb20302d Implement __len__ for trie hankcs 2021-01-14 01:10:17 -05:00
• d66c11fa9b Fix transformer tokenizer when add_special_tokens = False hankcs 2021-01-14 00:54:28 -05:00
• 372132abc2 For nested NER, use the longest span hankcs 2021-01-13 22:22:40 -05:00
• af6b58bcbd Enhance error message for download errors hankcs 2021-01-13 12:21:41 -05:00
• a6cb474c3f Allow anonymous user to use RESTful API hankcs 2021-01-11 23:03:08 -05:00
• b8747d9fc5 Upgrade shared modules hankcs 2021-01-11 12:48:57 -05:00
• 1b6631760b Support loading serialized dictionary for tokenizers hankcs 2021-01-11 12:35:42 -05:00
• 7229aea94c Save additional config hankcs 2021-01-11 12:28:08 -05:00
• af3e77a314 Type hints for Iterable[str] hankcs 2021-01-11 12:12:28 -05:00
• 05d1eeec91 Fix visualization of length-1 sentence hankcs 2021-01-10 22:43:16 -05:00
• 08ae2730b8 Optimize scalar mix hankcs 2021-01-10 20:56:22 -05:00
• d4e4753758 No need to cache test set hankcs 2021-01-09 14:36:13 -05:00
• f8c56d2c53 Scripts for preprocessing ontonotes hankcs 2021-01-06 11:34:44 -05:00
• f390e41d17 Improve jsonlines loading in JsonNERDataset hankcs 2021-01-08 13:03:52 -05:00
• 08995a5812 Revise document hankcs 2021-01-06 13:20:13 -05:00
• 67be9d18f8 Move multi-threading test into mtl test to speed up CI hankcs 2021-01-06 12:16:19 -05:00
• 8642990e0f Fix threading bug in transformers fix https://github.com/hankcs/HanLP/issues/1602 hankcs 2021-01-06 12:02:11 -05:00
• 509e067128 Revise document hankcs 2021-01-05 20:35:08 -05:00
• 2dcfdcbdec sighan2005 pku SOTA F1 96.70 script updated hankcs 2021-01-05 20:23:51 -05:00
• a9f9d7477c Scripts for preprocess Ontonotes 5 English hankcs 2021-01-05 13:56:15 -05:00
• 1ed3c59287 Specify transformers>=4.1.1 hankcs 2021-01-05 12:20:12 -05:00
• c4df4a9f72 Enable shuffling in SortingSampler hankcs 2021-01-05 00:44:02 -05:00
• fa9dc3946b Revise document hankcs 2021-01-04 22:41:57 -05:00
• ad4e1bb0f8 Use BinaryIO to avoid creating too many files hankcs 2021-01-04 16:26:04 -05:00
• 27dbf80639 Replace mul models hankcs 2021-01-04 15:43:45 -05:00
• fd9cff7d48 Implement Disk Cache for large dataset hankcs 2021-01-04 13:53:35 -05:00
• 29c3bf1b3a Revise document hankcs 2021-01-03 02:07:15 -05:00
• 4524dbaf00 Fix read_cells argument fix https://github.com/hankcs/HanLP/issues/1600 hankcs 2021-01-03 01:40:31 -05:00