Row 95165

Row ID: 95165 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 95165 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

Hi all,

I recently got interested in ML compilers, and wanted to ask some questions.

### 1. ML Compilers vs language compilers

I'm curious if ML compilers and language compilers have a lot in common. I only know a bit about the frontend part of a compiler, but it looks like ML compilers don't really have the usual lexical / syntax / semantic analysis phases that language compilers go through.

Would the backend part be much more relevant for ML compilers though? Would you recommend learning topics like IR optimization, register/memory allocation or SSA first before getting into ML compilers? It feels like ML compiler is a beast of its own, so I'm not sure if I should just dive into it, or having a background in traditional compiler backend would be still very helpful.

At least the [MLIR paper](https://arxiv.org/abs/2002.11054) seems to talk about SSA and IRs, so maybe having some compiler backend background is necessary? Just to clarify, I know the definition of SSA and IR, but here I'm talking about going in depths about these topics.

### 2. Focus areas within ML compilers

I'm also curious what are the areas that require the most amount of work within ML compilers? Is it the IR (or graph) optimization? Or something else? Do you think this domain is something that will last for decades, or mostly a few years effort and then users won't have to care about the internals anymore (just like how a normal user don't really care about how gcc or clang compiles C code too much nowadays)

FieldValue
text Hi all, I recently got interested in ML compilers, and wanted to ask some questions. ### 1. ML Compilers vs language compilers I'm curious if ML compilers and language compilers have a lot in common. I only know a bit about the frontend part of a compiler, but it looks like ML compilers don't really have the usual lexical / syntax / semantic analysis phases that language compilers go through. Would the backend part be much more relevant for ML compilers though? Would you recommend learning t…
label r/machinelearning
dataType post
communityName r/MachineLearning
datetime 2024-05-25
username_encoded Z0FBQUFBQm5Lak11ak1ub2M3eE9GblRlN3Z4VTdkazQ2X2lXZDZ1MWVCQXRXRnRtNlVtRGxNbEZxV09UbUVrb3ZCTXdWMTgzTndHeGJkd3NwUG9NM01vdmxtblhFaUZTOGc9PQ==
url_encoded Z0FBQUFBQm5LalBBNl9vMzlrekEyTzZOZWgtcHFkNUF6WWd1X1FCSjZSd3hQdm1FNGFUTnNQVTZiOVIxTkFkRkg1RUxvTVo1U2Rld3hlTFJ1SjRJYWNXMmsyX3pYeTJBYTdLSFotY3h3a0R3TUR2SWhmUnhSSUJjUDZ6V1Z1aWItT3NoTjZYLUFwekF2eE80dTZXZ2pBWms3Ylk3T2xoRW1NSlQ1cjhObWpxMlB4NnVkc1JiT3FoV0dBNDFkUlNmZTZldXA1Tlh5eERW

Raw Record

{
  "text": "Hi all,\n\nI recently got interested in ML compilers, and wanted to ask some questions.\n\n### 1. ML Compilers vs language compilers\n\nI'm curious if ML compilers and language compilers have a lot in common. I only know a bit about the frontend part of a compiler, but it looks like ML compilers don't really have the usual lexical / syntax / semantic analysis phases that language compilers go through.\n\nWould the backend part be much more relevant for ML compilers though? Would you recommend learning topics like IR optimization, register/memory allocation or SSA first before getting into ML compilers? It feels like ML compiler is a beast of its own, so I'm not sure if I should just dive into it, or having a background in traditional compiler backend would be still very helpful.\n\nAt least the [MLIR paper](https://arxiv.org/abs/2002.11054) seems to talk about SSA and IRs, so maybe having some compiler backend background is necessary? Just to clarify, I know the definition of SSA and IR, but here I'm talking about going in depths about these topics.\n\n### 2. Focus areas within ML compilers\n\nI'm also curious what are the areas that require the most amount of work within ML compilers? Is it the IR (or graph) optimization? Or something else? Do you think this domain is something that will last for decades, or mostly a few years effort and then users won't have to care about the internals anymore (just like how a normal user don't really care about how gcc or clang compiles C code too much nowadays)",
  "label": "r/machinelearning",
  "dataType": "post",
  "communityName": "r/MachineLearning",
  "datetime": "2024-05-25",
  "username_encoded": "Z0FBQUFBQm5Lak11ak1ub2M3eE9GblRlN3Z4VTdkazQ2X2lXZDZ1MWVCQXRXRnRtNlVtRGxNbEZxV09UbUVrb3ZCTXdWMTgzTndHeGJkd3NwUG9NM01vdmxtblhFaUZTOGc9PQ==",
  "url_encoded": "Z0FBQUFBQm5LalBBNl9vMzlrekEyTzZOZWgtcHFkNUF6WWd1X1FCSjZSd3hQdm1FNGFUTnNQVTZiOVIxTkFkRkg1RUxvTVo1U2Rld3hlTFJ1SjRJYWNXMmsyX3pYeTJBYTdLSFotY3h3a0R3TUR2SWhmUnhSSUJjUDZ6V1Z1aWItT3NoTjZYLUFwekF2eE80dTZXZ2pBWms3Ylk3T2xoRW1NSlQ1cjhObWpxMlB4NnVkc1JiT3FoV0dBNDFkUlNmZTZldXA1Tlh5eERW"
}
Explore Dataset Explore Row

Entry Information