FedEval

A Benchmark System with a Comprehensive Evaluation Model for Federated Learning. [GitHub]

• 1. Introduction
  • 1.1. The Evaluation Goals and Measures
  • 1.2. The Evaluation Framework
• 2. Environments
  • 2.1. Software Dependencies
  • 2.2. Build the Docker Image
  • 2.3. Download the dataset
• 3. Tutorials
  • 3.1. Quick Start (single experiment using terminal)
  • 3.2. Running Multiple Experiments (using scripts)
  • 3.3. Get to know the three configurations
  • 3.4. Get to know the FedEval.run and FedEval.run_util
  • 3.5. Customization
  • 3.6. Interface of FL Algorithms
  • 3.7. Interface of Callback Functions
• 4. Benchmarks
  • 4.1. Experiment Settings
  • 4.2. Radar Chart
• 5. API Reference
  • 5.1. FedEval