Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

InfiniTensor/InfiniBench

Repository files navigation

InfiniMetrics

An InfiniTensor-Featured Comprehensive Accelerator Evaluation Framework

Format Check Issues Pull Requests License

A unified, modular testing framework for comprehensive performance evaluation of accelerator hardware and software stacks.


🎯 Overview

InfiniMetrics provides standardized interfaces for benchmarking across multiple layers:

  • Hardware-Level: GPU memory bandwidth, cache performance, compute capabilities
  • Operator-Level: Individual operation performance (FLOPS, latency)
  • Inference-Level: End-to-end model inference throughput and latency
  • Communication-Level: NCCL collective operations and inter-GPU communication

Key Features

  • Unified Adapter Interface - Consistent API across all test types and frameworks
  • Extensible Architecture - Easy to add new test types, frameworks, and metrics
  • Comprehensive Metrics - Scalar values, time-series data, custom measurements
  • Framework Agnostic - Support for InfiniLM, vLLM, InfiniCore, and more
  • Production Ready - Robust error handling, logging, and result aggregation

πŸ“š Documentation

For detailed guides, configuration, and examples, see the full documentation.

Quick Links


🀝 Contributing

Contributions are welcome! Please see our Contributing Guide for details.

  1. Fork the repository
  2. Create your feature branch (git checkout -b feature/AmazingFeature)
  3. Commit your changes (git commit -m 'Add some AmazingFeature')
  4. Push to the branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

πŸ“„ License

This project is licensed under the MIT License - see the LICENSE file for details.


Built with ❀️ by the InfiniTensor Team

Website | Documentation | GitHub

About

An InfiniTensor-featured comprehensive accelerator evaluation framework

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

Contributors

AltStyle γ«γ‚ˆγ£γ¦ε€‰ζ›γ•γ‚ŒγŸγƒšγƒΌγ‚Έ (->γ‚ͺγƒͺγ‚ΈγƒŠγƒ«) /