Row 5301

Row ID: 5301 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 5301 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

**Paper**: [https://arxiv.org/abs/2402.15332](https://arxiv.org/abs/2402.15332)

**Project page**: [https://categoricaldeeplearning.com/](https://categoricaldeeplearning.com/)

**Abstract**:

>We present our position on the elusive quest for a general-purpose framework for specifying and studying deep learning architectures. Our opinion is that the key attempts made so far lack a coherent bridge between specifying *constraints* which models must satisfy and specifying their *implementations*. Focusing on building a such a bridge, we propose to apply category theory -- precisely, the universal *algebra of monads* valued in a 2-category of *parametric maps* -- as a single theory elegantly subsuming both of these flavours of neural network design. To defend our position, we show how this theory recovers constraints induced by geometric deep learning, as well as implementations of many architectures drawn from the diverse landscape of neural networks, such as RNNs. We also illustrate how the theory naturally encodes many standard constructs in computer science and automata theory.

FieldValue
text **Paper**: [https://arxiv.org/abs/2402.15332](https://arxiv.org/abs/2402.15332) **Project page**: [https://categoricaldeeplearning.com/](https://categoricaldeeplearning.com/) **Abstract**: >We present our position on the elusive quest for a general-purpose framework for specifying and studying deep learning architectures. Our opinion is that the key attempts made so far lack a coherent bridge between specifying *constraints* which models must satisfy and specifying their *implementations*. Fo…
label r/neuralnetworks
dataType post
communityName r/neuralnetworks
datetime 2024-04-28
username_encoded Z0FBQUFBQm5LakwyZTliamE3SUUxd3JKMWtOM3k2MW9zQVdZbmYteC01N182SDllbnpEZmpIYnpiMm9jZTlLeHRsdm9ZSVphb3NGcXJ2ZmIyQWwzNGJxUjdpVHhONzBna1E9PQ==
url_encoded Z0FBQUFBQm5Lak9GNkNTRng4Mi1kSkp1bWtHdnd0UHRGZkZlbW5YMVJKUWdiMzRKTVV4R2EtRGI0VUFGN1VzRll1OEE2Umt2eXdHZ0ZkaG1FRF9ScndHTkZfc3ZVLU5VNGQ5XzFhZk4xSHhQbEwzbTlRVVdQb2pkR1lIb2RtSHF6TVBFZ01VQW5KRWtVNFl1aDZBZ0F0ZUd0ajZTb29mYjlVcTdBMExqVHN0TElqbXVMdGtwUmdkUXNXQjR6UlVQZGhMYllvTzB3RXMwOG0yZEdhNjQzakhEQ3FOb0U4eTRIQT09

Raw Record

{
  "text": "**Paper**: [https://arxiv.org/abs/2402.15332](https://arxiv.org/abs/2402.15332)\n\n**Project page**: [https://categoricaldeeplearning.com/](https://categoricaldeeplearning.com/)\n\n**Abstract**:\n\n>We present our position on the elusive quest for a general-purpose framework for specifying and studying deep learning architectures. Our opinion is that the key attempts made so far lack a coherent bridge between specifying *constraints* which models must satisfy and specifying their *implementations*. Focusing on building a such a bridge, we propose to apply category theory -- precisely, the universal *algebra of monads* valued in a 2-category of *parametric maps* -- as a single theory elegantly subsuming both of these flavours of neural network design. To defend our position, we show how this theory recovers constraints induced by geometric deep learning, as well as implementations of many architectures drawn from the diverse landscape of neural networks, such as RNNs. We also illustrate how the theory naturally encodes many standard constructs in computer science and automata theory.",
  "label": "r/neuralnetworks",
  "dataType": "post",
  "communityName": "r/neuralnetworks",
  "datetime": "2024-04-28",
  "username_encoded": "Z0FBQUFBQm5LakwyZTliamE3SUUxd3JKMWtOM3k2MW9zQVdZbmYteC01N182SDllbnpEZmpIYnpiMm9jZTlLeHRsdm9ZSVphb3NGcXJ2ZmIyQWwzNGJxUjdpVHhONzBna1E9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9GNkNTRng4Mi1kSkp1bWtHdnd0UHRGZkZlbW5YMVJKUWdiMzRKTVV4R2EtRGI0VUFGN1VzRll1OEE2Umt2eXdHZ0ZkaG1FRF9ScndHTkZfc3ZVLU5VNGQ5XzFhZk4xSHhQbEwzbTlRVVdQb2pkR1lIb2RtSHF6TVBFZ01VQW5KRWtVNFl1aDZBZ0F0ZUd0ajZTb29mYjlVcTdBMExqVHN0TElqbXVMdGtwUmdkUXNXQjR6UlVQZGhMYllvTzB3RXMwOG0yZEdhNjQzakhEQ3FOb0U4eTRIQT09"
}

Entry Information