pytext latest version

« Changelog History

pytext v0.3.3 Release Notes

• 🆕 New features

  • ➕ Add XLM-R document classification server + console (#1358)
  • MLP layer embed for float tensors and FloatListSeqTensorizer for List[List[[float]] features. (#1374)
  • ➕ Add class_accuracy in MultiLabelSoftClassificationMetrics (#1371)
  • ➕ Add an option to skip test run after models have been trained (#1372)
  • 👌 Support DP in PyText (#1366)
  • Support torchscriptify in multi_label_classification_layer (#1350)
  • ➕ Add custom metric class for reporting Joint model metrics (#1339)
  • MultiLabel-MultiClass Model for Joint Sequence Tagging (#1335)
  • 👍 Scripted tokenizer support for DocModel (#1314)

  🛠 Bugfixes

  • 🛠 Fixed metric reporter aggregation and output layer for the multi-label classification
  • Remove move_state_dict_to_gpu, which is causing CUDA OOM (#1367)
  • 🛠 Fix Flow's default conversion of dict to AttrDict
  • 🛠 Fix bug in ClassificationOutputLayer that pad_idx is never respected (#1347)
  • 🛠 Serializing/Deserializing type Any: bugfix and simplification (#1344)
  • 🛠 Fix RoBERTa Q&A Training Bug with multiple BoS tokens. (#1343)

  Other

  • 👍 Better error message for misconfigured data fields
  • 🗄 Replace deprecated integer division with floor division operator
  • ➕ Add informative prints to assert statements (#1360)
  • TorchScript: Put dense tensor on the same device with other input tensors (#1361)
  • ⚡️ Update PyTorch + ONNX (#1340)
  • ⚡️ Update PyTorch + ONNX (#1340)- binary ONNX
  • ⚡️ Update PR Template (#1349)
  • ⬇️ Reduce memory request for pytext train operator
  • ➕ Add 'contrib' directory for experimental code (#1333)

Previous changes from v0.3.2

• 🆕 New features

  • ➕ Add Roberta model into BertPairwiseModel (#1336)
  • 👌 Support read file from http URL (#1317)
  • add a new PyText get_num_examples_from_batch function in model (#1319)
  • ➕ Add support for length label smoothing (#1308)
  • ➕ Add new metrics type for Masked Seq2Seq Joint Model (#1304)
  • ➕ Add mask generator and strategy (#1302)
  • ➕ Add separate logging for label loss and length loss (#1294)
  • ➕ Add tensorizer support for masking of target tokens (#1297)
  • ➕ Add length prediction and basic masked generator (#1290)
  • Add self attention option to conv_encoder and conv_decoder (#1291)
  • Entity Saliency modeling on PyText: EntitySalienceMetricReporter/EntitySalienceTask
  • In-batch negative training for BertPairwiseModel
  • 👌 Support embedding from decoder (#1284)
  • ➕ Add dense features to Roberta
  • ➕ Add projection layer to HuggingFace encoder (#1273)
  • ➕ add PyText Embedding TorchScript Wrapper
  • ➕ Add option to pad missing label in LabelListTensorizer (#1269)
  • ↔ Integrate PET and Introduce ElasticTrainer (#1266)
  • 👌 support PoolingType in DocNN. (#1259)
  • ➕ Added WordSeqEmbedding (#1255)
  • Open source Assistant NLU seq2seq model (#1236)
  • 👌 Support multi label classification
  • BART in decoupled model

  🐛 Bug fixes

  • 🛠 Fix Incorrect State Dict Assumption (#1326)
  • 🐛 Bug fix for "RoBERTaTensorizer object has no attribute is_input" (#1334)
  • Cast model output to cpu (#1329)
  • 🛠 Fix OSS predict-py API (#1320)
  • 🛠 Fix "calling median on empty tensor" issue in MR (#1322)
  • ➕ Add ScriptDoNothingTokenizer so that torchscriptification of SPM does not fail (#1316)
  • 🛠 Fix creating generator everytime (#1301)
  • 🛠 fix dense feature for fp16
  • 👀 Avoid edge cases with quantization by setting a known seed (#1295)
  • 👉 Make torchscript predictions even on empty text / token inputs
  • 🛠 fix dense feature TorchScript typing (#1281)
  • avoid zero division error in metrics reporter (#1271)
  • 🛠 Fix contiguous issue in bilstm export (#1270)
  • 🛠 fix debug file generation for multilabel classification (#1247)
  • 🛠 Fix fp16 optimizer attribute name

  Other

  • Simplify contextual embedding dimension computation in PyText (#1331)
  • 🆕 New Debug File for masked seq2seq
  • 🚚 Move MockConfigLoader to OSS (#1324)
  • ⚡️ Pass in optimizer config instead of create_optimizer to trainer
  • ✂ Remove unnecessary torch.no_grad() block (#1323)
  • 🛠 Fix Memory Issues in Metric Reporter for Classification Tasks over large Label Spaces
  • ➕ Add contextual embedding support to OS seq2seq model (#1299)
  • recover xlm_r tutorial notebook (#1305)
  • Enable controlling bias in MLP decoder
  • Migrate serving tutorial to TorchScript (#1310)
  • ✂ delete caffe2 export (#1307)
  • ➕ add whitelist for ONNX export
  • 👉 Use dynamic quantization api for BeamSearch (#1303)
  • ✂ Remove requirement that eos/bos be supplied for sequence export. (#1300)
  • 👍 Multicolumn support
  • 👍 Multicolumn support in torchscriptify
  • ➕ Add caching support to RawExample and batch predict API (#1298)
  • ➕ Add save-pytext-snapshot command to PyText cmdline (#1285)
  • ⚡️ Update with Whatsapp calling data + support dictionary features (#1293)
  • add arrange_caffe2_model_inputs in BaseModel (#1292)
  • ✅ Replace unit-tests on LMModel and FLLanguageModelingTask by LiteLMModel and FLLiteLMTask (#1296)
  • 🔄 changes to make mbart work (#1911)
  • 🖐 handle encoder and decoder embedding
  • ➕ Add tutorial for semantic parsing. (#1288)
  • ➕ Add new fb beam search with fused operator (#1287)
  • 🏗 Move generator builder to constructor so that it can easily overridden. (#1286)
  • Torchscriptify ELTensorizer (#1282)
  • Torchscript export for Seq2Seq model (#1265)
  • 🔄 Change Seq2Seq model from_config() to a more general api (#1280)
  • add max_seq_len to DocNN TorchScript model (#1279)
  • 👌 support XLM-R model Embedding in TorchScript (#1278)
  • Generic PyText Checkpoint Manager Interface (#1267)
  • 🛠 Fix backward compatibility issue of pad_missing in LabelListTensorizer (#1277)
  • ⚡️ Update mean reduction in NLLLoss (#1272)
  • migrate pages.integrity.scam.docnn_models.xxx (#1275)
  • Unify model input for ByteTokensDocumentModel (#1274)
  • Torchscriptify TokenTensorizer
  • 👍 Allow dictionaries to overwrite entries with #fairseq:overwrite comment (#1073)
  • 👉 Make WordSeqEmbedding ONNX compatible
  • If the snapshot path provided is not valid, throw error (#1268)
  • 👌 support vocab filter by min count
  • Unify input for TorchScript Tensorizers and Models (#1256)
  • Torchscriptify XLM-R
  • ➕ Add class logging to task (#1264)
  • ➕ Add usage logging to exporter (#1262)
  • ➕ Add usage logging across models (#1263)
  • 🌲 Usage logging on data classes (#1261)
  • 👍 GPT2 BPE add lower casing support (#1260)
  • FAISS Embedding Search Space [3/5]
  • Return len of tokens of each sequence in SeqTokenTensorizer (#1254)
  • Vocab Limited Pretrained Embedding [2/5] (#1248)
  • ➕ add Stage.OTHERS and allow TB to print to a seperate prefix not in (TRAIN, TEST, EVAL) (#1258)
  • ➕ Add option to skip 2 stage tokenizer and bpe decode sequences in the debug file (#1257)
  • ➕ Add Testcase for Wordpiece Tokenizer (#1249)
  • modify accuracy calculation for multi-label classification (#1244)
  • Enable tests in pytext/config:pytext_all_config_test
  • 🌲 Introduce Class Usage Logging (#1243)
  • 👉 Make PyText compatible with Any type (#1242)
  • 👉 Make dict_embedding Torchscript friendly (#1240)
  • 👌 Support MultipleData for export and kd generation
  • ✂ delete flaky/broken tests (#1238)
  • ➕ Add support for returning start & end indices.

• All Versions
• Previous v0.3.2