[go: nahoru, domu]

Skip to content

A collection of reusable and cross-platform automation recipes (CM scripts) with a human-friendly interface and minimal dependencies to make it easier to build, run, benchmark and optimize AI, ML and other applications and systems across diverse and continuously changing models, data sets, software and hardware (cloud/edge)

License

Notifications You must be signed in to change notification settings

GATEOverflow/cm4mlops

 
 

Repository files navigation

Unified and cross-platform CM interface for DevOps, MLOps and MLPerf

arXiv License Python Version Powered by CM. Downloads

CM script automation test CM script automation features test MLPerf inference MLCommons C++ ResNet50

This repository contains reusable and cross-platform automation recipes to run DevOps, MLOps, AIOps and MLPerf via a simple and human-readable Collective Mind interface (CM) while adapting to different operating systems, software and hardware.

All СM scripts have a simple Python API, extensible JSON/YAML meta description and unified input/output to make them reusable in different projects either individually or by chaining them together into portable automation workflows, applications and web services adaptable to continuously changing models, data sets, software and hardware.

Citing this project

Please use this BibTeX file.

Catalog

Online catalog: cKnowledge, MLCommons.

Examples

Run image classificaiton via CM

pip install cmind -U

cm pull repo mlcommons@cm4mlops --branch=dev

cmr "python app image-classification onnx" --quiet

Run MLPerf inference benchmark via CM

pip install cm4mlperf -U

cm run script --tags=run-mlperf,inference,_performance-only,_short  \
   --division=open \
   --category=edge \
   --device=cpu \
   --model=resnet50 \
   --precision=float32 \
   --implementation=mlcommons-python \
   --backend=onnxruntime \
   --scenario=Offline \
   --execution_mode=test \
   --power=no \
   --adr.python.version_min=3.8 \
   --clean \
   --compliance=no \
   --quiet \
   --time

License

Apache 2.0

Acknowledgments

We thank cKnowledge.org, cTuning foundation and MLCommons for sponsoring this project!

We also thank all volunteers, collaborators and contributors for their support, fruitful discussions, and useful feedback!

About

A collection of reusable and cross-platform automation recipes (CM scripts) with a human-friendly interface and minimal dependencies to make it easier to build, run, benchmark and optimize AI, ML and other applications and systems across diverse and continuously changing models, data sets, software and hardware (cloud/edge)

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 74.8%
  • Shell 10.5%
  • C++ 8.2%
  • C 3.4%
  • Batchfile 2.2%
  • Dockerfile 0.5%
  • Other 0.4%