FreshPorts -- textproc/py-tiktoken: Fast BPE tokeniser for use with OpenAI's models


FreshPorts -- The Place For Ports [画像:notbug]As an Amazon Associate I earn from qualifying purchases.
Want a good read? Try FreeBSD Mastery: Jails (IT Mastery Book 15)
Want a good monitor light? See my photos
All times are UTC [画像:Ukraine]
The recently imposed "must be logged in" restriction is a response to increased bot traffic on the site. This affects search, commits, and vuxml pages.
Search engines are not blocked. Try using "site:www.freshports.org" and your search terms.
After the ports freeze to fix some stuff, the freeze is over. I have some work to do before FreshPorts can start processing commits again before it can start processing again. I've created an issue for that.
Port details
py-tiktoken Fast BPE tokeniser for use with OpenAI's models
0.14.0 textproc on this many watch lists=0 search for ports that depend on this port Find issues related to this port Report an issue related to this port View this port on Repology. pkg-fallout 0.13.0_1Version of this port present on the latest quarterly branch.
Maintainer: sunpoet@FreeBSD.org search for ports maintained by this maintainer
Port Added: 2023年08月21日 17:15:36
Last Update: 2026年08月31日 05:41:31
Commit Hash: 1029869
Also Listed In: python
License: MIT
WWW:
https://github.com/openai/tiktoken
Description:
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Homepage cgit ¦ Codeberg ¦ GitHub ¦ GitLab ¦ SVNWeb - no subversion history for this port

Manual pages:
FreshPorts has no man page information for this port.
pkg-plist: as obtained via: make generate-plist
There is no configure plist information for this port.
USE_RC_SUBR (Service Scripts)
  • no SUBR information found for this port
Dependency lines:
  • ${PYTHON_PKGNAMEPREFIX}tiktoken>0:textproc/py-tiktoken@${PY_FLAVOR}
To install the port:
cd /usr/ports/textproc/py-tiktoken/ && make install clean
To add the package, run one of these commands:
  • pkg install textproc/py-tiktoken
  • pkg install py312-tiktoken
NOTE: If this package has multiple flavors (see below), then use one of them instead of the name specified above.
NOTE: This is a Python port. Instead of py312-tiktoken listed in the above command, you can pick from the names under the Packages section.
PKGNAME: py312-tiktoken
Package flavors (<flavor>: <package>)
  • py312: py312-tiktoken
distinfo:
TIMESTAMP = 1787588034 SHA256 (tiktoken-0.14.0.tar.gz) = 231dec90efcdccf1b565a1416107736f1e09b1a08fe736ef9d6363e626d03874 SIZE (tiktoken-0.14.0.tar.gz) = 38898

Expand this list (54 items)

Collapse this list.

SHA256 (rust/crates/aho-corasick-1.1.5.crate) = c982642fa9e8606056828ee9a8505737230110bb1099153c79efe865c59d12ba SIZE (rust/crates/aho-corasick-1.1.5.crate) = 184315 SHA256 (rust/crates/bit-set-0.8.0.crate) = 08807e080ed7f9d5433fa9b275196cfc35414f66a0c79d864dc51a0d825231a3 SIZE (rust/crates/bit-set-0.8.0.crate) = 16289 SHA256 (rust/crates/bit-vec-0.8.0.crate) = 5e764a1d40d510daf35e07be9eb06e75770908c27d411ee6c92109c9840eaaf7 SIZE (rust/crates/bit-vec-0.8.0.crate) = 24132 SHA256 (rust/crates/bstr-1.13.1.crate) = 6bb31b46c14244e20ee9984b11bf5c992b91fb6939fea616e3512c8baecdbe5f SIZE (rust/crates/bstr-1.13.1.crate) = 356631 SHA256 (rust/crates/fancy-regex-0.19.0.crate) = 476de73bddf2ef8490aa4ee8f1cf40b430bf1d56c48c22080e5186952cd580e6 SIZE (rust/crates/fancy-regex-0.19.0.crate) = 224156 SHA256 (rust/crates/heck-0.5.0.crate) = 2304e00983f87ffb38b55b444b5e3b60a884b5d30c0fca7d82fe33449bbe55ea SIZE (rust/crates/heck-0.5.0.crate) = 11517 SHA256 (rust/crates/libc-0.2.189.crate) = 3eaf3ede3fee6db1a4c2ee091bf8a8b4dccdc6d17f656fb07896ee72867612f2 SIZE (rust/crates/libc-0.2.189.crate) = 851502 SHA256 (rust/crates/memchr-2.8.3.crate) = cf8baf1c55e62ffcace7a9f06f4bd9cd3f0c4beb022d3b367256b91b87513d98 SIZE (rust/crates/memchr-2.8.3.crate) = 99165 SHA256 (rust/crates/once_cell-1.21.4.crate) = 9f7c3e4beb33f85d45ae3e3a1792185706c8e16d043238c593331cc7cd313b50 SIZE (rust/crates/once_cell-1.21.4.crate) = 35010 SHA256 (rust/crates/portable-atomic-1.15.0.crate) = 05c8b63e8d9609db387f0324918f81d68fe27748f084ef092fb35954d0539a85 SIZE (rust/crates/portable-atomic-1.15.0.crate) = 202705 SHA256 (rust/crates/proc-macro2-1.0.107.crate) = 985e7ec9bb745e6ce6535b544d84d6cd6f7ad8bd711c398938ae983b91a766d9 SIZE (rust/crates/proc-macro2-1.0.107.crate) = 59588 SHA256 (rust/crates/pyo3-0.29.2.crate) = 4688ddedf473e32662b9b067670129a8afb8c18e351482c70d62ba4a88171e8b SIZE (rust/crates/pyo3-0.29.2.crate) = 1255741 SHA256 (rust/crates/pyo3-build-config-0.29.2.crate) = f41027e41b4bd03f6e60f9f417fe24a6341a6bb744edd62b6f709f2a52ea30e9 SIZE (rust/crates/pyo3-build-config-0.29.2.crate) = 41104 SHA256 (rust/crates/pyo3-ffi-0.29.2.crate) = e591a95526fead067432c3b3a33fc74770b87b1e04e73671090d9c2055a2b327 SIZE (rust/crates/pyo3-ffi-0.29.2.crate) = 90029 SHA256 (rust/crates/pyo3-macros-0.29.2.crate) = 73225868fc1cd84eef2c3c230ddb91273bf1de46aeb8a4248da76d32a0924a1c SIZE (rust/crates/pyo3-macros-0.29.2.crate) = 9044 SHA256 (rust/crates/pyo3-macros-backend-0.29.2.crate) = 571575aa3749fa6216757dd47d2a3e7ef360f329a40f0666a9fbd14889024952 SIZE (rust/crates/pyo3-macros-backend-0.29.2.crate) = 93749 SHA256 (rust/crates/quote-1.0.47.crate) = 1fbf4db142a473a8d80c26bbf18454ed458bf8d26c8219c331daecfdbd079001 SIZE (rust/crates/quote-1.0.47.crate) = 31622 SHA256 (rust/crates/regex-1.13.1.crate) = f020237b6c8eed93db2e2cb53c00c60a8e1bc73da7d073199a1180401450218d SIZE (rust/crates/regex-1.13.1.crate) = 157118 SHA256 (rust/crates/regex-automata-0.4.18.crate) = ad8553b9b26413251cbf30e620595c7a41b3887f03da04579c0e6b0d6a06b4b2 SIZE (rust/crates/regex-automata-0.4.18.crate) = 628707 SHA256 (rust/crates/regex-syntax-0.8.11.crate) = d6f6ff9a378485b298a5286656da665ba74413d36db0979633275d2e708145d4 SIZE (rust/crates/regex-syntax-0.8.11.crate) = 359055 SHA256 (rust/crates/rustc-hash-2.1.3.crate) = 6b1e7f9a428571be2dc5bc0505c13fb6bf936822b894ec87abf8a08a4e51742d SIZE (rust/crates/rustc-hash-2.1.3.crate) = 14811 SHA256 (rust/crates/serde_core-1.0.229.crate) = 67dca2c9c51e58a4791a4b1ed58308b39c64224d349a935ab5039aa360942a48 SIZE (rust/crates/serde_core-1.0.229.crate) = 63100 SHA256 (rust/crates/serde_derive-1.0.229.crate) = e7a5d71263a5a7d47b41f6b3f06ba276f10cc18b0931f1799f710578e2309348 SIZE (rust/crates/serde_derive-1.0.229.crate) = 59864 SHA256 (rust/crates/syn-2.0.119.crate) = 872831b642d1a07999a962a351ed35b955ea2cfc8f3862091e2a240a84f17297 SIZE (rust/crates/syn-2.0.119.crate) = 307407 SHA256 (rust/crates/syn-3.0.4.crate) = e6275cddf4610d1775e6d1fe9469b2e77d0f39fd98fb7450901b821e0c53649f SIZE (rust/crates/syn-3.0.4.crate) = 313047 SHA256 (rust/crates/target-lexicon-0.13.5.crate) = adb6935a6f5c20170eeceb1a3835a49e12e19d792f6dd344ccc76a985ca5a6ca SIZE (rust/crates/target-lexicon-0.13.5.crate) = 26928 SHA256 (rust/crates/unicode-ident-1.0.24.crate) = e6e4313cd5fcd3dad5cafa179702e2b244f760991f45397d14d4ebf38247da75 SIZE (rust/crates/unicode-ident-1.0.24.crate) = 49298

Collapse this list.


Packages (timestamps in pop-ups are UTC):
py39-tiktoken
ABIaarch64amd64armv6armv7i386powerpcpowerpc64powerpc64le
FreeBSD:13:latest-----n/an/an/a
FreeBSD:13:quarterly-----n/an/an/a
FreeBSD:14:latest--------
FreeBSD:14:quarterly------0.5.20.5.2
FreeBSD:15:latest--n/a-n/an/a0.5.2_1-
FreeBSD:15:quarterly--n/a-n/an/a--
FreeBSD:16:latest--n/a-n/an/a--
 
py311-tiktoken
ABIaarch64amd64armv6armv7i386powerpcpowerpc64powerpc64le
FreeBSD:13:latest0.12.0_40.12.0_5-0.11.00.12.0_5n/an/an/a
FreeBSD:13:quarterly0.12.0_40.12.0_4-0.9.0_30.12.0_4n/an/an/a
FreeBSD:14:latest---0.9.0_4----
FreeBSD:14:quarterly---0.9.0_3----
FreeBSD:15:latest--n/a0.9.0_4n/an/a--
FreeBSD:15:quarterly--n/a-n/an/a--
FreeBSD:16:latest--n/a-n/an/a--
 
py312-tiktoken
ABIaarch64amd64armv6armv7i386powerpcpowerpc64powerpc64le
FreeBSD:13:latest-----n/an/an/a
FreeBSD:13:quarterly-----n/an/an/a
FreeBSD:14:latest0.13.0_20.13.0_2--0.13.0_2---
FreeBSD:14:quarterly0.13.0_10.13.0_1--0.13.0_1---
FreeBSD:15:latest0.13.0_20.13.0_2n/a-n/an/a--
FreeBSD:15:quarterly0.13.0_10.13.0_1n/a-n/an/a--
FreeBSD:16:latest0.13.0_20.13.0_2n/a-n/an/a--
 
Dependencies
NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.
Build dependencies:
  1. py312-setuptools>=62.4 : devel/py-setuptools@py312
  2. py312-setuptools-rust>=1.5.2 : devel/py-setuptools-rust@py312
  3. py312-wheel>=0 : devel/py-wheel@py312
  4. rust>=1.97.0 : lang/rust
  5. python3.12 : lang/python312
  6. py312-build>=0 : devel/py-build@py312
  7. py312-installer>=0 : devel/py-installer@py312
Test dependencies:
  1. python3.12 : lang/python312
Runtime dependencies:
  1. py312-regex>=0 : textproc/py-regex@py312
  2. py312-requests>=0 : www/py-requests@py312
  3. python3.12 : lang/python312
This port is required by:
for Run
  1. misc/chatblade
  2. misc/py-ag2
  3. misc/py-autogen
  4. misc/py-crewai-tools
  5. misc/py-langchain-openai
  6. misc/py-litellm
  7. misc/py-llama-index-core
Expand this list (12 items / 5 hidden - sorry, this count includes any deleted ports)
  1. Collapse this list).
  2. misc/py-mistral-common
  3. misc/py-openai-whisper
  4. misc/py-transformers
  5. misc/py-vllm
  6. Collapse this list.

Deleted ports which required this port:

Expand this list of 1 deleted port
  1. misc/py-aider-chat *
  2. Collapse this list of deleted ports.
* - deleted ports are only shown under the This port is required by section. It was harder to do for the Required section. Perhaps later...

Configuration Options:
===> The following configuration options are available for py312-tiktoken-0.14.0: BLOBFILE=off: Blob file support ===> Use 'make config' to modify these settings
Options name:
textproc_py-tiktoken
USES:
cargo python
FreshPorts was unable to extract/find any pkg message
Master Sites:
Expand this list (2 items)
Collapse this list.
  1. https://files.pythonhosted.org/packages/source/t/tiktoken/
  2. https://pypi.org/packages/source/t/tiktoken/
Collapse this list.

Number of commits found: 39

Commit History - (may be incomplete: for full details, see links to repositories near top of page)
CommitCreditsLog message
0.14.0
31 Aug 2026 05:41:31
commit hash: 1029869395c0618763ae7b400c3feeb12c8e01d4 commit hash: 1029869395c0618763ae7b400c3feeb12c8e01d4 commit hash: 1029869395c0618763ae7b400c3feeb12c8e01d4 commit hash: 1029869395c0618763ae7b400c3feeb12c8e01d4 files touched by this commit
Po-Chuan Hsieh (sunpoet) search for other commits by this committer
textproc/py-tiktoken: Update to 0.14.0
Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md 
0.13.0_2
21 Jul 2026 06:47:24
commit hash: 9c892d26015fa543bc587dcd7d241c57af7e13f4 commit hash: 9c892d26015fa543bc587dcd7d241c57af7e13f4 commit hash: 9c892d26015fa543bc587dcd7d241c57af7e13f4 commit hash: 9c892d26015fa543bc587dcd7d241c57af7e13f4 files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.97.1
PR:		296645 
0.13.0_1
04 Jun 2026 08:52:51
commit hash: e29b5eeec31db62161d9f83c4ea2ddff023e5d00 commit hash: e29b5eeec31db62161d9f83c4ea2ddff023e5d00 commit hash: e29b5eeec31db62161d9f83c4ea2ddff023e5d00 commit hash: e29b5eeec31db62161d9f83c4ea2ddff023e5d00 files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.96.0
PR:		295694 
0.13.0
21 May 2026 14:52:10
commit hash: 5eb8865629707e72a06fb8fbf1959566cec7f4e3 commit hash: 5eb8865629707e72a06fb8fbf1959566cec7f4e3 commit hash: 5eb8865629707e72a06fb8fbf1959566cec7f4e3 commit hash: 5eb8865629707e72a06fb8fbf1959566cec7f4e3 files touched by this commit
Po-Chuan Hsieh (sunpoet) search for other commits by this committer
textproc/py-tiktoken: Update to 0.13.0
Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md 
0.12.0_5
27 Apr 2026 12:26:47
commit hash: 17bf498fd2289d1c8b6319ea897d3dd307eac991 commit hash: 17bf498fd2289d1c8b6319ea897d3dd307eac991 commit hash: 17bf498fd2289d1c8b6319ea897d3dd307eac991 commit hash: 17bf498fd2289d1c8b6319ea897d3dd307eac991 files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.95.0
PR:		294615 
0.12.0_4
23 Mar 2026 07:33:11
commit hash: 43f5b4a72fea3f97a2fc7d5d37f671b82377feb2 commit hash: 43f5b4a72fea3f97a2fc7d5d37f671b82377feb2 commit hash: 43f5b4a72fea3f97a2fc7d5d37f671b82377feb2 commit hash: 43f5b4a72fea3f97a2fc7d5d37f671b82377feb2 files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.94.0
PR:		293615 
0.12.0_3
28 Jan 2026 08:48:51
commit hash: 3d631100e8aa692b0bdc32c1ac4d11d4caf1a0a9 commit hash: 3d631100e8aa692b0bdc32c1ac4d11d4caf1a0a9 commit hash: 3d631100e8aa692b0bdc32c1ac4d11d4caf1a0a9 commit hash: 3d631100e8aa692b0bdc32c1ac4d11d4caf1a0a9 files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.93.0
PR:		292360 
0.12.0_2
16 Dec 2025 12:12:31
commit hash: 5e496c77078638a3777140084ddcb183d51966f6 commit hash: 5e496c77078638a3777140084ddcb183d51966f6 commit hash: 5e496c77078638a3777140084ddcb183d51966f6 commit hash: 5e496c77078638a3777140084ddcb183d51966f6 files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.92.0
PR:		291582 
0.12.0_1
11 Nov 2025 11:08:12
commit hash: d6b6027df632188ab408921f04e155b729b9e76e commit hash: d6b6027df632188ab408921f04e155b729b9e76e commit hash: d6b6027df632188ab408921f04e155b729b9e76e commit hash: d6b6027df632188ab408921f04e155b729b9e76e files touched by this commit Sanity Test Failure
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.91.1
PR:		290816 
0.12.0
01 Nov 2025 17:23:22
commit hash: 1403bb7765965eccd644a73cb136a155e46f7ea8 commit hash: 1403bb7765965eccd644a73cb136a155e46f7ea8 commit hash: 1403bb7765965eccd644a73cb136a155e46f7ea8 commit hash: 1403bb7765965eccd644a73cb136a155e46f7ea8 files touched by this commit
Matthias Andree (mandree) search for other commits by this committer
*: Revise USES=python:... version range constraints
and strip all lower bounds of 3.9 or 3.10 because they are implied now.
python:3.9-X -> python:-X
python:3.9+ -> python
python:3.10-X -> python:-X
python:3.10+ -> python
(options such as ,build preserved)
0.12.0
18 Oct 2025 23:54:36
commit hash: a88fb1ee0c67ad2a15f610eed088fadd4813479f commit hash: a88fb1ee0c67ad2a15f610eed088fadd4813479f commit hash: a88fb1ee0c67ad2a15f610eed088fadd4813479f commit hash: a88fb1ee0c67ad2a15f610eed088fadd4813479f files touched by this commit
Po-Chuan Hsieh (sunpoet) search for other commits by this committer
textproc/py-tiktoken: Update to 0.12.0
Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md 
0.11.0_1
03 Oct 2025 08:16:50
commit hash: 97b5de4ffc2a512051f354fbcb2a184f3e002b2f commit hash: 97b5de4ffc2a512051f354fbcb2a184f3e002b2f commit hash: 97b5de4ffc2a512051f354fbcb2a184f3e002b2f commit hash: 97b5de4ffc2a512051f354fbcb2a184f3e002b2f files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.90.0
PR:		289709 
0.11.0
07 Sep 2025 23:04:12
commit hash: e901c585fbcb554bf49a920d3d53a961f2b2b0ae commit hash: e901c585fbcb554bf49a920d3d53a961f2b2b0ae commit hash: e901c585fbcb554bf49a920d3d53a961f2b2b0ae commit hash: e901c585fbcb554bf49a920d3d53a961f2b2b0ae files touched by this commit
Po-Chuan Hsieh (sunpoet) search for other commits by this committer
textproc/py-tiktoken: Update to 0.11.0
Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md 
0.9.0_5
01 Sep 2025 08:25:04
commit hash: b21956d7db4b5a41c0e0c57c5cdca79ee89be9c6 commit hash: b21956d7db4b5a41c0e0c57c5cdca79ee89be9c6 commit hash: b21956d7db4b5a41c0e0c57c5cdca79ee89be9c6 commit hash: b21956d7db4b5a41c0e0c57c5cdca79ee89be9c6 files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.89.0
PR:		288923 
0.9.0_4
03 Jul 2025 08:46:01
commit hash: f3f7e555b06d9a87d63c047ce3e82e936a11f2fe commit hash: f3f7e555b06d9a87d63c047ce3e82e936a11f2fe commit hash: f3f7e555b06d9a87d63c047ce3e82e936a11f2fe commit hash: f3f7e555b06d9a87d63c047ce3e82e936a11f2fe files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.88.0
PR:		287766 
0.9.0_3
05 Jun 2025 07:52:53
commit hash: 3ed29b818520b4c5691c1c49d13fd6b89c3142ef commit hash: 3ed29b818520b4c5691c1c49d13fd6b89c3142ef commit hash: 3ed29b818520b4c5691c1c49d13fd6b89c3142ef commit hash: 3ed29b818520b4c5691c1c49d13fd6b89c3142ef files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.87.0
PR:		286829 
0.9.0_2
08 Apr 2025 08:41:13
commit hash: 2a5976aebeefd09d36fd4ac2e7e2eefde5491c0d commit hash: 2a5976aebeefd09d36fd4ac2e7e2eefde5491c0d commit hash: 2a5976aebeefd09d36fd4ac2e7e2eefde5491c0d commit hash: 2a5976aebeefd09d36fd4ac2e7e2eefde5491c0d files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.86.0
PR:		285840 
0.9.0_1
24 Feb 2025 07:55:52
commit hash: cf7c4b037d7e9cadfa539f3b9cd45396c1a00dfb commit hash: cf7c4b037d7e9cadfa539f3b9cd45396c1a00dfb commit hash: cf7c4b037d7e9cadfa539f3b9cd45396c1a00dfb commit hash: cf7c4b037d7e9cadfa539f3b9cd45396c1a00dfb files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.85.0
PR:		284884 
0.9.0
19 Feb 2025 11:54:48
commit hash: 4830cc4be071f5a69237855f8cdd7176768adb01 commit hash: 4830cc4be071f5a69237855f8cdd7176768adb01 commit hash: 4830cc4be071f5a69237855f8cdd7176768adb01 commit hash: 4830cc4be071f5a69237855f8cdd7176768adb01 files touched by this commit
Po-Chuan Hsieh (sunpoet) search for other commits by this committer
textproc/py-tiktoken: Update to 0.9.0
Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md 
0.8.0_3
20 Jan 2025 11:06:50
commit hash: fccaa1b326310b7f33556fe133b509260a90fe7f commit hash: fccaa1b326310b7f33556fe133b509260a90fe7f commit hash: fccaa1b326310b7f33556fe133b509260a90fe7f commit hash: fccaa1b326310b7f33556fe133b509260a90fe7f files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.84.0
PR:		283962 
0.8.0_2
01 Dec 2024 09:24:18
commit hash: 1d1fd15a3e499eed9e604dac94bab73c2fea4b2f commit hash: 1d1fd15a3e499eed9e604dac94bab73c2fea4b2f commit hash: 1d1fd15a3e499eed9e604dac94bab73c2fea4b2f commit hash: 1d1fd15a3e499eed9e604dac94bab73c2fea4b2f files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.83.0
PR:		283000 
0.8.0_1
08 Nov 2024 08:24:20
commit hash: ca048c2884dc9822310a87e2dfebb8b1647095e2 commit hash: ca048c2884dc9822310a87e2dfebb8b1647095e2 commit hash: ca048c2884dc9822310a87e2dfebb8b1647095e2 commit hash: ca048c2884dc9822310a87e2dfebb8b1647095e2 files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.82.0
PR:		282516 
0.8.0
14 Oct 2024 05:25:48
commit hash: b9ec26d2939593c8f7a67c1a5af171d2ef88a61b commit hash: b9ec26d2939593c8f7a67c1a5af171d2ef88a61b commit hash: b9ec26d2939593c8f7a67c1a5af171d2ef88a61b commit hash: b9ec26d2939593c8f7a67c1a5af171d2ef88a61b files touched by this commit
Po-Chuan Hsieh (sunpoet) search for other commits by this committer
textproc/py-tiktoken: Update to 0.8.0
Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md 
0.7.0_3
10 Sep 2024 11:00:34
commit hash: 89ab81d0e2eca6b298b0efd3f4577d468abf18d5 commit hash: 89ab81d0e2eca6b298b0efd3f4577d468abf18d5 commit hash: 89ab81d0e2eca6b298b0efd3f4577d468abf18d5 commit hash: 89ab81d0e2eca6b298b0efd3f4577d468abf18d5 files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.81.0
PR:		281300 
0.7.0_2
10 Sep 2024 10:58:07
commit hash: c0d07f1127793ffc97a6c1db78423d0d16bdc5ef commit hash: c0d07f1127793ffc97a6c1db78423d0d16bdc5ef commit hash: c0d07f1127793ffc97a6c1db78423d0d16bdc5ef commit hash: c0d07f1127793ffc97a6c1db78423d0d16bdc5ef files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
Author: Siva Mahadevan
*/*: remove STRIP_CMD calls in rust based ports
This is not needed after bc4fedc1fec0d359365c04d43be9e32bf101a50e
PR:		246993
Differential Revision:	https://reviews.freebsd.org/D46503 
0.7.0_2
26 Aug 2024 08:08:01
commit hash: 7a55f9542531c541f36ae5cf3a58d6ce92ec7bff commit hash: 7a55f9542531c541f36ae5cf3a58d6ce92ec7bff commit hash: 7a55f9542531c541f36ae5cf3a58d6ce92ec7bff commit hash: 7a55f9542531c541f36ae5cf3a58d6ce92ec7bff files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.80.1
PR:		280490 
0.7.0_1
18 Jun 2024 10:59:14
commit hash: 21476ca8a9b5feb3485a3fa29299c0b447c90350 commit hash: 21476ca8a9b5feb3485a3fa29299c0b447c90350 commit hash: 21476ca8a9b5feb3485a3fa29299c0b447c90350 commit hash: 21476ca8a9b5feb3485a3fa29299c0b447c90350 files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.79.0
PR:		279707 
0.7.0
19 May 2024 17:15:56
commit hash: 741835f949140931e2525cc378007fbc212c27a3 commit hash: 741835f949140931e2525cc378007fbc212c27a3 commit hash: 741835f949140931e2525cc378007fbc212c27a3 commit hash: 741835f949140931e2525cc378007fbc212c27a3 files touched by this commit
Po-Chuan Hsieh (sunpoet) search for other commits by this committer
textproc/py-tiktoken: Update to 0.7.0
Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md 
0.6.0_2
13 May 2024 11:03:24
commit hash: 2322b661000b69fcc75fe68fec25e5b4e48c2a8e commit hash: 2322b661000b69fcc75fe68fec25e5b4e48c2a8e commit hash: 2322b661000b69fcc75fe68fec25e5b4e48c2a8e commit hash: 2322b661000b69fcc75fe68fec25e5b4e48c2a8e files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.78.0
PR:		278834 
0.6.0_1
23 Mar 2024 09:41:46
commit hash: d632fbe55e45559d03a0bef7211913964aeba45a commit hash: d632fbe55e45559d03a0bef7211913964aeba45a commit hash: d632fbe55e45559d03a0bef7211913964aeba45a commit hash: d632fbe55e45559d03a0bef7211913964aeba45a files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.77.0
PR:		277786 
0.6.0
21 Feb 2024 15:08:04
commit hash: 4e17347e94db300992ec8544fd7cc7705c5d8c18 commit hash: 4e17347e94db300992ec8544fd7cc7705c5d8c18 commit hash: 4e17347e94db300992ec8544fd7cc7705c5d8c18 commit hash: 4e17347e94db300992ec8544fd7cc7705c5d8c18 files touched by this commit
Po-Chuan Hsieh (sunpoet) search for other commits by this committer
textproc/py-tiktoken: Update to 0.6.0
Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md 
0.5.2_2
19 Feb 2024 11:59:23
commit hash: 7f5a7b0e524c8d32727681a4324905e350dc433c commit hash: 7f5a7b0e524c8d32727681a4324905e350dc433c commit hash: 7f5a7b0e524c8d32727681a4324905e350dc433c commit hash: 7f5a7b0e524c8d32727681a4324905e350dc433c files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.76.0
PR:		276920 
0.5.2_1
09 Jan 2024 12:15:54
commit hash: 109c3d4629b84972e660b689d169ac0761c1a519 commit hash: 109c3d4629b84972e660b689d169ac0761c1a519 commit hash: 109c3d4629b84972e660b689d169ac0761c1a519 commit hash: 109c3d4629b84972e660b689d169ac0761c1a519 files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.75.0
PR:		276033 
0.5.2
14 Dec 2023 05:48:32
commit hash: d3c7291cd247fef7bb9faed43d35b38c37dd1c6f commit hash: d3c7291cd247fef7bb9faed43d35b38c37dd1c6f commit hash: d3c7291cd247fef7bb9faed43d35b38c37dd1c6f commit hash: d3c7291cd247fef7bb9faed43d35b38c37dd1c6f files touched by this commit
Po-Chuan Hsieh (sunpoet) search for other commits by this committer
textproc/py-tiktoken: Update to 0.5.2
Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md 
0.5.1_2
08 Dec 2023 15:04:09
commit hash: b2afd89fb26437c5d9810b131370525352e63f71 commit hash: b2afd89fb26437c5d9810b131370525352e63f71 commit hash: b2afd89fb26437c5d9810b131370525352e63f71 commit hash: b2afd89fb26437c5d9810b131370525352e63f71 files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.74.1
PR:		275243 
0.5.1_1
24 Oct 2023 10:22:32
commit hash: dd10dc88a7cf54f9aa164bf40cc5e481021401d6 commit hash: dd10dc88a7cf54f9aa164bf40cc5e481021401d6 commit hash: dd10dc88a7cf54f9aa164bf40cc5e481021401d6 commit hash: dd10dc88a7cf54f9aa164bf40cc5e481021401d6 files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.73.0
PR:		274499 
0.5.1
22 Sep 2023 03:19:31
commit hash: 227e43a0b0373cf0e65d381134ed5561db9a05a8 commit hash: 227e43a0b0373cf0e65d381134ed5561db9a05a8 commit hash: 227e43a0b0373cf0e65d381134ed5561db9a05a8 commit hash: 227e43a0b0373cf0e65d381134ed5561db9a05a8 files touched by this commit
Po-Chuan Hsieh (sunpoet) search for other commits by this committer
textproc/py-tiktoken: Update to 0.5.1
Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md 
0.4.0_1
08 Sep 2023 09:06:24
commit hash: aba8da2be191461126505c67726fa87345ae63f8 commit hash: aba8da2be191461126505c67726fa87345ae63f8 commit hash: aba8da2be191461126505c67726fa87345ae63f8 commit hash: aba8da2be191461126505c67726fa87345ae63f8 files touched by this commit
Mikael Urankar (mikael) search for other commits by this committer
lang/rust: Bump revisions after 1.72.0
PR:		273331 
0.4.0
21 Aug 2023 17:01:58
commit hash: 6c34be9ab1b27410b400e03f8281f03d4f956fa3 commit hash: 6c34be9ab1b27410b400e03f8281f03d4f956fa3 commit hash: 6c34be9ab1b27410b400e03f8281f03d4f956fa3 commit hash: 6c34be9ab1b27410b400e03f8281f03d4f956fa3 files touched by this commit
Po-Chuan Hsieh (sunpoet) search for other commits by this committer
textproc/py-tiktoken: Add py-tiktoken 0.4.0
tiktoken is a fast BPE tokeniser for use with OpenAI's models.

Number of commits found: 39

Login
User Login
Create account

Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD

This site
What is FreshPorts?
About the authors
Issues
FAQ
How big is it?
Security Policy
Privacy
Blog
Contact

Search
Enter Keywords:
more...

Latest Vulnerabilities
electron42 Sep 03
libnjs Sep 03
nginx-full Sep 03
njs Sep 03
chromium Sep 02
jenkins Sep 02
jenkins-lts Sep 02
erlang Sep 01
erlang Sep 01

30 vulnerabilities affecting 415 ports have been reported in the past 14 days

* - modified, not new

All vulnerabilities

Last processed:
2026年09月03日 17:10:13 UTC


Ports
Home
Categories
Deleted ports
Sanity Test Failures
Newsfeeds

Statistics
Graphs
NEW Graphs (Javascript)

Calculated hourly:
Port count 35095
Broken 77
Ignore 190

Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD Valid HTML, CSS, and RSS. Copyright © 2000-2026 Dan Langille. All rights reserved.

AltStyle によって変換されたページ (->オリジナル) /