[from, if training transformers were an actual data average by tracking symbolic gradients across thresholds]
something i’ve done sometimes is try to make a symbolic equation solver. this usually goes away about halfway through, but something that’s interesting about it is that it’s clearly not very complicated to do. it’s also a bit of a big work. anyway it seems it’s useful to have a symbolic algebra framework.
maybe i could use a thread like this to draft such things/more.
class Expression {};
class OperatorExpression {}; // an expression that is the evaluation of a parameterized operator on operands (could elide into Expression);
class Operator {};