1
0
Fork
You've already forked frequency-analysis
0
A program to do lexical frequency analysis, written in C and Julia for speed and fun :)
  • C 75.1%
  • Julia 20.7%
  • Makefile 4.2%
2024年01月24日 12:30:23 -05:00
c move C implementation to a seperate folder 2024年01月21日 13:46:32 -05:00
examples don't automatically add examples 2024年01月08日 00:08:16 -05:00
.gitignore clean up project files 2024年01月08日 00:06:05 -05:00
freq.jl update docs 2024年01月24日 12:30:23 -05:00
Frequency.jl to_csv: wrap key in quotation marks to distinguish from strings with 2024年01月23日 12:08:45 -05:00
LICENSE Add MPL 2024年01月08日 00:03:29 -05:00
README.md update docs 2024年01月24日 12:30:23 -05:00

Frequency Analysis

This is an experiment in doing frequency analysis over large amounts of text. This was originally accomplished in C (found in c/), but I decided to re-implement it in Julia because it allowed me to maintain most of the speed from C while making processing substantially easier, as it included tools for working with Unicode text, as well as other string processing utilities.

The program is freq.jl, which relies on library functions found at Freqency.jl. The program aggregates data from inputs, and outputs a CSV of words to stdout.

Usage: julia -t$NTHREADS freq.jl path/to/inputs/* > output.csv. $NTHREADS is assumed to be the number of threads for Julia to use.