## Wednesday, June 24, 2015

### Idea of modeling non-linearity as learning distrtibution over function spaces in feedforward neural network

I was thinking about relationship in graphical context of graphical models and feedforward neural network. On one hand, Feedforward Neural Network is a graph of deterministic functions and on the other hand, Graphical models are graph of dependence of random variable which are uncertain. Then I thought what if deterministic non-linearities can be replace with random process which generates functions and shared non-linearity can be inferred.

An interesting idea would be to learn a distribution over function space(which will be used as non-linearity in Feedforward Neural Networks) jointly with backpropagation in an EM like fashion.

To summarize, We want to replace the deterministic function with a learned function by modeling the distribution over function space and inferring the shared non-linearity in neural network.

## Sunday, June 7, 2015

### Squeezing space with LaTeX

I was trying to find ways  to correct large vertical spaces between paragraphs. After serching a bit on internet, I got the following command along with other options. So I wanted to share it here and for my own future reference.
Remove the spac­ing between para­graphs and have a small para­graph indentation
\setlength{\parskip}{0cm}
\setlength{\parindent}{1em}

Source:
http://robjhyndman.com/hyndsight/squeezing-space-with-latex/
http://www.terminally-incoherent.com/blog/2007/09/19/latex-squeezing-the-vertical-white-space/
http://www-h.eng.cam.ac.uk/help/tpl/textprocessing/squeeze.html
https://ravirao.wordpress.com/2005/11/19/latex-tips-to-meet-publication-page-limits/

Make your text block as big as pos­si­ble. The sim­plest way to do that is using the geom­e­try package:
 \usepackage[text={16cm,24cm}]{geometry}
Use a com­pact font such as Times Roman:
 \usepackage{mathptmx}
 \usepackage[compact]{titlesec} \titlespacing{\section}{0pt}{2ex}{1ex} \titlespacing{\subsection}{0pt}{1ex}{0ex} \titlespacing{\subsubsection}{0pt}{0.5ex}{0ex}
 \usepackage{paralist}
 \begin{compactitem} \item ... \end{compactitem} \begin{compactenum} \item ... \end{compactenum}
 \usepackage{multicols}
 \begin{multicols}{2} ... \end{multicols}
 \begin{document}\fontsize{11.5}{14}\rm
 \linespread{0.9}
There is also a savetrees pack­age which does a lot of squeez­ing, but the results don’t always look nice, so it is bet­ter to try one or more of the above tricks instead.