cTuning

cTuning foundation is a non-profit research, development and education organization and a founding member of MLCommons. It was established by Grigori Fursin in 2014 to help the develop open-source tools to automate manual, tedious and repetitive ResearchOps, facilitate collaborative and reproducible research, accelerate AI and Systems innovation, co-design efficient AI/ML systems, enable open science, and simplify transfer of the state-of-the-art research to production: https://www.acm.org/publications/reproducibility . We are very glad and proud that our open-source workflow automation technology (Collective Knowledge aka CK v1,v2, Collective Mind aka CM, CM4MLOps, CM4MLPerf and CM4ABTF) has been adopted by MLCommons (125+ AI software and hardware companies) to make it easier to run MLPerf benchmarks and submit results via open challenges: https://arxiv.org/abs/2406.16791 , https://access.cknowledge.org/playground/?action=challenges . We also help AI, ML and systems conferences organize artifact evaluation and reproducibility initiatives since 2014: https://cTuning.org/ae Learn more about community initiatives and open-source tools at our website.