Deep Learning Overview

View my Deep Learning Overview : [Google Slides] Deep Learning Research Projects: [Google Slides] Beware, these things get out of date very quick. This presentation is from Oct 2016. The outline of the talk: Toy Neural Network Loss Function Stochastic Gradient Descent Forward-pass (Neural Function Evaluation) Backward-pass (Gradient of Neural function wrt to params) Recent … Continue reading Deep Learning Overview →

Parallel Bulk Image Resizing – Python

Usually multi-threaded programming can be typically. One typically will need a queue to maintain the inputs. From this thread-safe queue the threads pick an input, act on it and save the result. This can usually take up most of the afternoon depending on the job. This recipe is adapted from [link]. It introduces a way … Continue reading Parallel Bulk Image Resizing – Python →

Installing cuDNN Ubuntu 14.04

cuDNN is a cuda library which provides basic operations like forward and backward passes for neural networks on GPU. This is used by caffe and other toolkits. You can download cuDNN from : https://developer.nvidia.com/cudnn. Note that you need to login to be able to download. This post is just for my own reminder on cuDNN installation. … Continue reading Installing cuDNN Ubuntu 14.04 →

Toy Neural Network

In my last post on neural network [HERE], I talked on how one can think of neural network as universal approximators. In this post I am trying to help understand a toy neural network implementation. In particular one can have a clearer and intuitive understanding of what a forward_pass is and what back_propagation means. Most … Continue reading Toy Neural Network →

Neural Network as Universal Approximators : Intuitive Explaination

Came across this wonderful explanation of why the neural network with hidden layer are universal approximators. Although not very helpful for practical purpose gives an intuitive feel of why neural network give reasonable results. The basic idea is to analyze a sigmoid function as you change w and b . In particular effect on $latex \sigma( w\times x … Continue reading Neural Network as Universal Approximators : Intuitive Explaination →

Blogs/Websites I follow

Vision/ML research Blogs http://www.computervisionblog.com/ http://nghiaho.com/ http://deeplearning.net/ http://karpathy.github.io/ http://timdettmers.com/ https://research.googleblog.com/ http://research.baidu.com/baidu-tech-blog/ https://research.facebook.com/blog/ CV/ML Softwares https://lvdmaaten.github.io/software/ http://cs.brown.edu/~pff/code.html http://www.peterkovesi.com/ http://vision.princeton.edu/code.html Notable Pages https://github.com/ChristosChristofidis/awesome-deep-learning https://github.com/jtoy/awesome-tensorflow

Graph Segmentation of Images

Use of graph representation of an image for segmentation. This is based on the following paper which is one of the most cited papers in Computer Vision. If you are starting to do research in computer vision related fields it is a good idea to understand few of those papers in as much detail as possible. … Continue reading Graph Segmentation of Images →

Tutorial Slides on Computer Network

I was a TA for HKUST course ELEC 4120 during spring of 2014 and spring of 2015. The slides here are supplementary material for the course. It contains additional explanations of the concepts, more numerical problems, and exercises. For more details of the concepts refer to the course notes of the instructor. Additionally and ideally … Continue reading Tutorial Slides on Computer Network →

Programming with Joystick on Linux

Was trying to figure out a way to programatically use the Cyborg Controller lying around in the lab. My final objective is to control objects and view points in RViz. In this blog, I will explore how to get inputs from it with a C/C++ program. The Linux kernel provides an API to control this. … Continue reading Programming with Joystick on Linux →

Vision Controlled Quadcopter Flight

Just completed (8th Dec, 2015) the Aerial Robotics course in HKUST (ELEC6910P) by Prof. SHEN Shaojie (my PhD supervisor). Most of the course credit were on the completion of the projects. Course TAs were Su Kunyue and Yang Zhengfei. My project partners were Sun Lin and Sun Ting The projects eventually connected together to make a vision … Continue reading Vision Controlled Quadcopter Flight →