An axiomatic approach to differentiation of polynomial circuits

Reverse derivative categories (RDCs) have recently been shown to be a suitable semantic framework for studying machine learning algorithms. Whereas emphasis has been put on training methodologies, less attention has been devoted to particular model classes: the concrete categories whose morphisms re...

Full description

Saved in:
Bibliographic Details
Published inJournal of logical and algebraic methods in programming Vol. 135; p. 100892
Main Authors Wilson, Paul, Zanasi, Fabio
Format Journal Article
LanguageEnglish
Published Elsevier Inc 01.10.2023
Online AccessGet full text

Cover

Loading…
More Information
Summary:Reverse derivative categories (RDCs) have recently been shown to be a suitable semantic framework for studying machine learning algorithms. Whereas emphasis has been put on training methodologies, less attention has been devoted to particular model classes: the concrete categories whose morphisms represent machine learning models. In this paper we study presentations by generators and equations of classes of RDCs. In particular, we propose polynomial circuits as a suitable machine learning model class. We give an axiomatisation for these circuits and prove a functional completeness result. Finally, we discuss the use of polynomial circuits over specific semirings to perform machine learning with discrete values.
ISSN:2352-2208
DOI:10.1016/j.jlamp.2023.100892