[D] Regarding the relation between algorithmic information theory and Machine Learning and is there research being pursued in that direction?

Show HN: Data engineering learning path with recommended resources
October 18, 2020
Google announces Pixel 4A 5G with larger 6.2-inch display for $499
October 18, 2020

[D] Regarding the relation between algorithmic information theory and Machine Learning and is there research being pursued in that direction?


So I was reading the article on Kolmogorov Complexity from this nice article here and I realized that this field of theoretical computer science was basically “given some object, how far can we compress it in a Turing Machine” and it has given some great results and tools.

So I had an intuition that “maybe in some way it can be applied to machine learning models” but I was not able to find much that is why I want to ask to this community:

  • Is my intuition “wrong” in some sense?
  • Is there some research being pursued which uses the tools from algorithmic information theory to broaden theoretical machine learning?

submitted by /u/berzerker_x
[link] [comments]

Source

Comments are closed.