Popular Posts

Wednesday, June 24, 2015

Idea of modeling non-linearity as learning distrtibution over function spaces in feedforward neural network

I was thinking about relationship in graphical context of graphical models and feedforward neural network. On one hand, Feedforward Neural Network is a graph of deterministic functions and on the other hand, Graphical models are graph of dependence of random variable which are uncertain. Then I thought what if deterministic non-linearities can be replace with random process which generates functions and shared non-linearity can be inferred.

An interesting idea would be to learn a distribution over function space(which will be used as non-linearity in Feedforward Neural Networks) jointly with backpropagation in an EM like fashion.

To summarize, We want to replace the deterministic function with a learned function by modeling the distribution over function space and inferring the shared non-linearity in neural network.

Sunday, June 7, 2015

Squeezing space with LaTeX

I was trying to find ways  to correct large vertical spaces between paragraphs. After serching a bit on internet, I got the following command along with other options. So I wanted to share it here and for my own future reference.
Remove the spac­ing between para­graphs and have a small para­graph indentation
\setlength{\parskip}{0cm}
\setlength{\parindent}{1em}
 
Source:
http://robjhyndman.com/hyndsight/squeezing-space-with-latex/
http://www.terminally-incoherent.com/blog/2007/09/19/latex-squeezing-the-vertical-white-space/
http://www-h.eng.cam.ac.uk/help/tpl/textprocessing/squeeze.html
https://ravirao.wordpress.com/2005/11/19/latex-tips-to-meet-publication-page-limits/

Make your text block as big as pos­si­ble. The sim­plest way to do that is using the geom­e­try package:
\usepackage[text={16cm,24cm}]{geometry}
Use a com­pact font such as Times Roman:
\usepackage{mathptmx}
Remove space around sec­tion headings.
\usepackage[compact]{titlesec}
\titlespacing{\section}{0pt}{2ex}{1ex}
\titlespacing{\subsection}{0pt}{1ex}{0ex}
\titlespacing{\subsubsection}{0pt}{0.5ex}{0ex}
Beware of enu­mer­ated and item­ized lists. Instead, replace them with com­pact lists.
\usepackage{paralist}
\begin{compactitem}
\item ...
\end{compactitem}
\begin{compactenum}
\item ...
\end{compactenum}
If you are allowed, switch­ing to dou­ble col­umn can save heaps of space.
\usepackage{multicols}
\begin{multicols}{2}
...
\end{multicols}
If the rules say 12pt, you can usu­ally get away with 11.5pt with­out any­one noticing:
\begin{document}\fontsize{11.5}{14}\rm
When you get des­per­ate, you can squeeze the inter-​​line spac­ing using
\linespread{0.9}
There is also a savetrees pack­age which does a lot of squeez­ing, but the results don’t always look nice, so it is bet­ter to try one or more of the above tricks instead.