| 
  • If you are citizen of an European Union member nation, you may not use this service unless you are at least 16 years old.

  • Work with all your cloud files (Drive, Dropbox, and Slack and Gmail attachments) and documents (Google Docs, Sheets, and Notion) in one place. Try Dokkio (from the makers of PBworks) for free. Now available on the web, Mac, Windows, and as a Chrome extension!

View
 

Theory

Page history last edited by olivier 15 years, 1 month ago

Foundations of Learning Theory

 

Machine Learning relates to many different domains: data analysis, data processing, information retrieval, statistics, knowledge discovery, reasoning under uncertainty, game theory, decision theory...

 

But the main distinguishing feature of the learning problem is that it requires a form of reasoning which is non-deductive: it requires induction, transduction, abduction or generalization.

 

As a result, the learning problem has its roots in the following theories

 

 

  • Formalizing decision-making and interactions
    • Decision Theory W
    • Auction Theory W
    • Rational Choice Theory, Public choice theory, Social choice theory, General equilibrium theory W...
    • Portfolio Theory W, Sharpe ratio W
    • Theory of Risk Aversion W, Utility W
    • Game Theory W, Mechanism Design W, What is Game Theory?, by D. K. Levine.
    • Finance, Gambling Theory W, Arbitrage W, Prediction Markets W, Efficient market theory W, Value-at-Risk W, Hedge W
    • Interpretation of Probability W

 

  • Formalizing information and regularity
    • Information Theory W
    • Algorithmic Information Theory W
    • Compression W, Universal compression
    • Randomness W

 

  • Formalizing Inference
    • Logic Inference
    • Inductive Inference W
    • Statistical Inference
    • Estimation Theory

 

  • Tools
    • Probability Theory
    • Optimization Theory
    • Algorithms, Computation Theory
    • Functional Analysis
    • Approximation Theory

Comments (0)

You don't have permission to comment on this page.