Pull requests: NVIDIA/FasterTransformer

New pull request New

39 Open 130 Closed

Pull requests list

fix: fix position_encoding_table memory error.

#791 opened Mar 27, 2024 by johnson-magic

Fix shape mismatch on the masked_tokens param in decoder masked multi-head attention kernel.

#773 opened Oct 24, 2023 by FengDSP

Include stdio.h

#770 opened Oct 19, 2023 by JihaoXin

Ft llama opt

#762 opened Oct 2, 2023 by dypshong

Support Seq length up to 8K

#756 opened Sep 4, 2023 by zhen-jia

[BugFix] GPT inference error when pipeline_para_size > 1 and int8_mode != 0

#750 opened Aug 23, 2023 by 00why00

[Bugfix] GptJ & GptNeoX batch inference error

#742 opened Aug 11, 2023 by YZP17121579

Add fusion-for-decoder-only for llama

#733 opened Jul 28, 2023 by binxuan

Fix beam search output_log_prob index error

#732 opened Jul 25, 2023 by cpm0722

[Doc] Add projects section in README which is developed based on FasterTransformer

#731 opened Jul 25, 2023 by lvhan028

Add triton fastertransformer backend support for deberta

#725 opened Jul 19, 2023 by sfc-gh-zhwang

Add cuDNN include path as a common include dir

#724 opened Jul 18, 2023 by jacobkahn

fix: initialize tiled_prompt_lengths_buf_ to zero in gptneox

#716 opened Jul 13, 2023 by yandai

Remove parenthesis from asserts

#699 opened Jul 2, 2023 by miguelusque

Huggingface gptj convert script supports sharded checkpoint

#695 opened Jun 29, 2023 by skyser2003

[Doc] Fix typo in gpt_guide.md

#682 opened Jun 26, 2023 by myry96

swin-transformer quantization readme files changes

#675 opened Jun 16, 2023 by Mhhhaster

fix: fix Qk_vec_acum_fp32_ has already been declared

#659 opened Jun 9, 2023 by lkm2835

gptneox & gptj int8 quantization & share context

#653 opened Jun 7, 2023 by rahuan

Add missing headers

#648 opened Jun 1, 2023 by brian14708

Fix TOC of gptneox_guide.md

#633 opened May 23, 2023 by xu-song

Update gpt_guide.md: documentation link is invalid

#620 opened May 22, 2023 by treycheng

fix multi-gpu build

#616 opened May 17, 2023 by dskhudia

Fix mpi library linking issue

#612 opened May 16, 2023 by liangfu

remove buggy duplicated code

#609 opened May 12, 2023 by chenho74

ProTip! Updated in the last three days: updated:>2025年10月21日.

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Pull requests: NVIDIA/FasterTransformer

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Pull requests list