Research interests

We approach to our research topics with Deep Neural Networks.

* Image Processing Algorithm for Inverse Problems
There are a  lot of scenarios to enhance image quality such as denoising, inpainting, dealiasing, etc. These application can be properly approximated with 
precise mathematical models such as Gaussian/Poisson noise model, inverse problems. The bottom figure showed our algorithm (Robust ALOHA) enables to remove random-valued impulsive noises with low-rank Hankel Matrix approaches.
figure from Jin, Kyong Hwan, and Jong Chul Ye. "Sparse and low-rank decomposition of a Hankel structured matrix for impulse noise removal." IEEE Transactions on Image Processing 27.3 (2017): 1448-1461.

Recently, those applications are resolved by a trainable deep network given by (c) in the bottom figure. We investigate core characters of neural networks for image processing.

figure from Jin, Kyong Hwan, et al. "Deep convolutional neural network for inverse problems in imaging." IEEE Transactions on Image Processing 26.9 (2017): 4509-4522.


* Computational Photography - HDR, Multi-Frame Denoising
Camera is a complex system which has a lot of ill-posed inverse problems inside. Especially, many hand-crafted digital processing tasks -computational photography -such as demosaicking, denoising, auto-exposure, white-balance, HDR (high dynamic range scene), alignment, are handled  in ISP (image signal processor). Nowadays, such signal processing in chips has transferred into neural-networks in academia and presented in many channels. We investigate conventional image processing in computational photography with deep neural networks.


* Image Enhancement - Decontouring, Lossless/Lossy Compression Artifact Removal
For image transferring or video streaming, compressed bitstreams are conveyed through communication's net. During compression of contents, several artifacts arose such as contouring, blocky artifacts, color inconsistency, quantization errors, etc. People are unpleasant to such artifacts, so we would like to suppress those artifacts with deterministic processing or learnable neural networks. Main difference of this task with previous inverse problems is that ground-truth is always accessible (very important for supervised learning) because compression techniques begin their processing from original  contents.



* Generative Neural Network for Multi-channel/Multi-dimensional Data
We investigate a novel unsupervised/semi-supervised deep-learning-based algorithm to solve the inverse problem found in dynamic magnetic resonance imaging (MRI). Our method needs neither prior training nor additional data; in particular, it does not require either electrocardiogram or spokes-reordering in the context of cardiac images. It generalizes to sequences of images the recently introduced deep-image-prior approach. The essence of the proposed algorithm is to proceed in two steps to fit k-space synthetic measurements to sparsely acquired dynamic MRI data.

                    
                   
figure from Jin, Kyong Hwan, et al. "Time-Dependent Deep Image Prior for Dynamic MRI." arXiv preprint arXiv:1910.01684 (2019).





Subpages (2): history <2020 Patents