Exca - Execution and caching infrastructure

Summary

• Exca - Execution and caching
  • Challenge #1: Early configuration validation
  • Challenge #2: Complex experiments - hierarchical configurations
  • Challenge #3: Experiment/computation caching
• Tutorials
  • Installation
  • Two types of infra: Task and Map
  • Quick comparison
  • Simplified infra decorator
  • Pydantic models
• How-to guide
  • Debugging
  • Asynchronous computation with TaskInfra
  • Monitoring
  • Efficient caching: cache and class uid exclusion
  • Infra Versioning & default heritage
  • Using pydantic’s discriminator
  • Workdir/code copy
• Explanations
  • Why? The philosophy
  • MapInfra / Task Infra differences
  • uid computation
  • ConfDict
  • Caching
• API Reference
  • TaskInfra
  • MapInfra
  • SubmitInfra
  • Associated classes and functions

Citing

@misc{exca,
    author = {J. Rapin and J.-R. King},
    title = {{Exca - Execution and caching}},
    year = {2024},
    publisher = {GitHub},
    journal = {GitHub repository},
    howpublished = {\url{https://github.com/facebookresearch/exca}},
}

Legal

exca is MIT licensed, as found in the LICENSE file. Also check-out Meta Open Source Terms of Use and Privacy Policy.