Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings
/ SearchBigFile Public template

UI and Java8 program to search big files like 100s of MB

License

Notifications You must be signed in to change notification settings

svermaji/SearchBigFile

Repository files navigation

SearchBigFile

Utility in Java to search big file (tested with 400MB and 1GB+ log/text file)

  • For complete codebase in one refer branch complete-code
  • For the feature of favourite buttons and tagging in files and searches refer branch with-fav-in-recent
  • This branch master is targeted to have separate modules as UI and Core
  • Below modules are the dependencies for this project
    • Core-Parent module https://github.com/svermaji/Core-Parent
    • Core module https://github.com/svermaji/Core
    • UI module https://github.com/svermaji/SwingUI

Author Information

Test Results - with ByteBuffer implementation!!

  • File size [3GB], type [Text], lines processed [59999997] and pattern find [0] times, time taken [37sec]
  • File size [1GB], type [Text], lines processed [19499809] and pattern find [0] times, time taken [16sec]
  • Supports file of more size but time increases
  • For file less than 1GB BufferedReader will be used

Test Results - with BufferedReader implementation!!

  • File size [1GB], type [Text], lines processed [13147027] and pattern find [1094] times, time taken [8sec]
  • Supports file till 1GB only

Description

  • Pom.xml versions:
    • 1.0 - Contains all search feature from initial release till colors implemented
    • 2.0 - Implemented wrapping, style attributes and support long text in one line
      • Added theme support and key bindings
    • 3.0 - Planned to have multi file search support
  • Update for mixed algo depending on file size.
  • Now multi tab is supported.
  • Font size can be applied to application when used on high resolution machine.
  • Tooltip will have custom color and font.
  • Program stores the last searched file and search string.
  • Support search as you type
  • Clipboard support via menu
  • Memory indicator added to application, and can be used to free memory
  • If file to search/read does not exist then user has choice to remove it from recent entry
  • User can lock screen with a password and change password
  • Added export button and cleanup button for old exports.
  • Clipboard popup will appear to set file name.
  • Fonts/Colors will change only if window is active.
  • Application can be colored with highlight color for background and text.
  • Theme color comes on hover of tool buttons.
  • Drag n Drop file to set it in search text field.
  • Use F3/Shift-F3 to search text.
  • User can press Ctrl+F from anywhere to go to search box and hit enter to make Search.
  • Settings menu added to set change color of highlights and fonts for message bar automatically.
  • Added all occurrences table to search occurrences quicker with highlighted text.
    • No occurrences' message also present.
    • All occurrences table is inside split pane to resize it any time.
    • Multiple colors available for match, selected and selected background.
    • Color combination can be seen in the tooltip of each menu item.
  • Tabs present for help and results.
  • Help button text color changes to different colors every 10 sec.
  • Help can be seen in the browser with button click.
  • After 'Read' operation is performed Search pattern box can be used to find any string in existing result.
  • At start of program detail help will be displayed.
  • Warning and Info indicator will change font every 10 min. Font details will be in the tooltip.
  • In file path and search text box auto-complete feature is supported.
  • In case of hang, program tries to stop forcefully after 50 sec.
  • Controls to increase/decrease font size.
  • Shows number of lines processed till time while searching or reading.
  • Controls to next/previous occurrences.
  • A warning indicator is shown and show the occurrences so far in case if there are too many matches.
  • An indicator showing present font size of file contents pane.
  • File can be chosen by file chooser.
  • Controls to go first or last line.
  • ESC key can be used to hide inner-frame.
  • Match case and whole word search options are available.
  • Search button action will result only matched strings lines with highlighted background.
  • Line number will be displayed in blue at the start of line to match with an original file.
  • Summary will be displayed in title bar with file size, time taken and number of occurrences matched.
  • Another feature added to read last N (100-5000) lines of a file along with the highlight of search pattern
  • Recently searched files and search-patterns will be stored with shortcuts.
  • Additional filtering is provided to search among recent lists
  • Application displays warning if search runs for too long or too many search occurrences
  • Tooltip provided for maximum controls.
  • Validations applied as and when needed.

Images of different stages of development/features since day 1

AltStyle によって変換されたページ (->オリジナル) /