Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Analyzes Grid Engine log files converting them into a format suitable for time series analysis using Grafana.

License

NotificationsYou must be signed in to change notification settings

pat8901/hpc-data-parser

Repository files navigation

Grid Engine Log AnalyzerOverview:This program is designed to analyze Grid Engine log files and convert them into a format suitable for time series analysis using Grafana. It consists of a Java program for log file parsing and CSV creation, followed by a bash script to convert the CSV into a SQLite database.Features:    Reads Grid Engine log files and extracts relevant data.    Converts log file data into a CSV format.    Uses a bash script to create a SQLite database from the CSV file.    Generates binned data tables for use in time series analysis.Installation: (This program only runs on Linux systems. Only been tested on Ubuntu)    Ensure Java (JDK 11 or higher) is installed    Clone the repository: git clonehttps://github.com/pat8901/hpc-data-parser.git    Compile the Java program using the gradle wrapper: ./gradlew build    Ensure SQLite is installed on your system for the bash script to work.Usage:    Ensure that ge-log-analyzer-1.0.0.jar, make_db.sh, and ge_log_file are all in the same directory. (This limitation will be fixed in a later version release)    For example:        john@john-pc:~/Desktop/grid_engine_program$ ls        ge-log-analyzer-1.0.0.jar  make_db.sh  source_log.txt    Run the Java program: java -jar ge-log-analyzer-1.0.0.jar    Enter the path to the Grid Engine log file when prompted.    The program will create a CSV file with the reformatted data.     Using the newly created CSV file the program will automatically call the bash script to create a SQLite database with binned data tables.Requirements:    Java (JDK 11 or higher)    SQLite    Access to a Grafana server for visualization (optional)Example: (Bash)$ java -jar ge-log-analyzer-1.0.0Enter the path to the Grid Engine log file: /path/to/grid_engine.logLicense:This project is licensed under the MIT License - see the LICENSE file for details.

About

Analyzes Grid Engine log files converting them into a format suitable for time series analysis using Grafana.

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

[8]ページ先頭

©2009-2025 Movatter.jp