Ohad Dan
  • Research
  • Teaching
  • Blog
  • About
  • Research
  • Teaching
  • Blog
  • About

​​

Information and learning process

2/27/2017

 
I have recently completed participation in the academic course "introduction to information and learning process" given by (the one and only) Prof. Tali Tishby.
The course introduces the subjects of: Statistical (Bayesian) decision theory, parameter estimation, PAC learning, information theory and some more. I enjoyed the course as it both provides practical intuitions and formal tools to approach problems such as estimation with hidden variables, what are the computational bounds on learning and what are the theoretical constraint on information transfer. 

For the sake of future generations, I upload my course materials to this online folder. Especially noteworthy in these are my solutions to questions on:
  1. Neyman-pearson lemma, ROC curve, KL divergence and sequential probability ratio test
  2. Optimal Bayes estimator and maximum likelihood estimator
  3. Fisher information, Cramer-Rao bound and polynomial regression
  4. Data processing inequality, entropy of stationary Markov chain, Redundancy-synergy measure and Expectation maximization

    Matlab

    Archives

    February 2021
    June 2019
    January 2019
    February 2018
    January 2018
    February 2017
    June 2016
    May 2016
    April 2016
    March 2016

    Categories

    All
    Animation
    Art
    Computer Vision
    Graph-theory
    Image Processing
    Matlab

    RSS Feed

Powered by Create your own unique website with customizable templates.